- Original Article
- Open access
- Published:
Consensus about image quality assessment criteria of breast implants mammography using Delphi method with radiographers and radiologists
Insights into Imaging volume 11, Article number: 56 (2020)
Abstract
Aims
To identify image quality criteria that can be applied to assess breast implant (BI) mammograms according to radiologists and radiographers’ perspectives and to explore the level of agreement about criteria priority.
Methods
A two-round Delphi method using a questionnaire was applied to identify the level of agreement between experts, asking them to rank each image criteria available for mammography according to 4 possible answers (1 = need to have, 2 = nice to have, 3 = not pertinent/appropriate, 4 = do not know). Criteria for craniocaudal (CC), mediolateral-oblique (MLO) and lateral (ML), with and without Eklund manoeuvre, were included. This process was repeated after removing the less relevant criteria.
Results
Between first and second rounds, different results were obtained regarding the criteria to assess CC and MLO images. Details for anatomic areas were considered the most relevant by radiographers during the first round, while general criteria were prioritised during the second round. Radiologists focused more on analysis of the spread of the breast tissue, if the breast was aligned with detector’s centre and level of contrast. The analysis of implant flow, the BI anterior edge and the maximum retropulsion of BI when Eklund manoeuvre is performed were the specific aspects of BI imaging considered as relevant for assessment.
Conclusions
The importance of each criterion used to assess BI mammograms was not the same between radiographers and radiologists, suggesting the two groups of experts are looking for different requirements from the image. Further education and training is necessary to align strategies for assessing BI mammograms, and some criteria need to be adapted to reduce subjectivity.
Key points.
-
Two groups of experts (radiographers/radiologist) are looking for different IQ criteria.
-
Eklund manoeuvre mammograms should have specific IQ criteria.
-
BI mammograms must consider maximum retropulsion of the implant.
-
Visualisation of the implant anterior edge means all breast tissue is included.
-
Necessary to adapt the PNL criterion to different BI locations (subglandular/subpectoral).
Introduction
Breast cancer screening programs (BCSP) are implemented across the world with the aim of reducing mortality by detecting cancer in its initial stage to increase chances of survival with earlier therapy [1]. Even being controversial [2], mammography is still considered the gold standard in some countries as the initial examination if equivocal clinical assessments or suspected implant complications are observed, particularly for women over 50 years old and those over 40 years with breast implants (BI) [3]. However, concerns about BI mammography have been raised due to the possible impairment of cancer detection [4,5,6,7,8]. Implants are denser compared to breast tissue [9] bringing challenges in image acquisition, reading and interpretation. The available guidelines for standard mammography do not present appropriate recommendations when a patient has BI, regarding protocols and techniques or how to evaluate image quality (IQ), namely which criteria should be considered to ensure that the exam is adequate to perform diagnosis on images with implants that are denser compared to breast tissue [10,11,12,13]. With the implementation of digital mammography and breast tomosynthesis in BCSP across Europe, it is important to establish what are the best approaches for imaging the breast, including those with implants, namely protocols and techniques, but also how to evaluate and interpret the images. Considering there is limited evidence in published literature about IQ criteria for BI mammography assessment [7, 9, 14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33], this study aimed to identify image quality criteria that can be applied to assess breast implant mammograms according to both radiologists’ and radiographers’ perspectives. It also aimed to explore the level of agreement regarding the priority of each criterion to distinguish between those that must be verified and those that are not a priority to determine when an examination needs to be rejected and/or repeated.
Methods
To identify image quality criteria that can be applied to assess breast implant mammograms, a list of criteria available for standard mammography previously identified [34] was presented to a group of experts or stakeholders using a questionnaire and applying a two-round Delphi method [35,36,37,38]. The Delphi method provides an opportunity for experts/stakeholders to exchange viewpoints about a complex problem, to see how their evaluation of the issue aligns with others and to change their opinions, if desired, after reconsideration of the findings of the group’s work. The main stakeholders involved in this specific context are typically radiographers and radiologists. Radiographers have their role in the assessment of IQ immediately after acquiring the images and radiologists subsequently evaluate the images, to interpret and report the examination. Because of their respective roles, they were brought together and, with the guidance of a facilitator, their informed opinions were interrogated to create a final list of criteria to be used for assessing BI mammography examinations. The facilitator explained the objectives of this study and also the scale used to classify each criteria. The aim of the listed criteria was to help with deciding if an examination, including images in craniocaudal (CC), mediolateral-oblique (MLO), mediolateral (ML), acquired with and without Eklund Manoeuvre, presents all relevant imaging information to provide a diagnosis or if the examination should be repeated [39, 40]. The priority of each criterion was additionally explored. A consensus approach was used to define the level of agreement between the group members [35, 41]. According to the literature [35,36,37, 42], the group size can vary according to the purpose of the research or can be defined according to those who express interest in participating [36]. In this study, 10 participants (6 radiographers and 4 radiologists), all working in Swiss BCSP institutions, were invited to join the study after expressing their interest in the experience. All participants had a minimum of 7 years of experience in their respective profession.
The classical Delphi method was followed and involved 5 steps [36]:
- 1.
A questionnaire was submitted online to the experts (participants), which presented a list of criteria that was based on a previous study [34]. They were asked to identify which items could be applicable to assess BI mammograms and add others that were not noted in the list (Tables 1 and 2);
- 2.
The experts examined the criteria to categorise them as important or not and to ranked them according to the perceived level of importance as (a) need to have, (b) nice to have, (c) not pertinent/appropriate and (d) I do not know;
- 3.
Findings were analysed and presented to provide feedback to both radiographers and radiologists;
- 4.
After subsequent readjustments, a second list of criteria was submitted for another round of assessment by the experts;
- 5.
Finally, an agreement based on both rankings was attempted, to set a list of criteria to be applied by professionals working in a regional BCSP.
Parallel to the Delphi rounds, the same criteria identified during the literature review were used on a set of 1207 images to verify if they were applicable or not to real clinical scenarios and see if it is possible to assess each criterion when BI mammograms are acquired [34].
The 4-point Likert-type scale was used to rank each image criteria; the agreement percentage was calculated for the four levels of all criteria. The Kendall’s W (also known as Kendall’s coefficient of concordance) was then used to identify the level of agreement amongst the raters. Kendall’s W ranges from 0 (no agreement) to 1 (complete agreement) [47]. The statistical analysis was performed using Statistical Package for the Social Sciences (SPSS) version 23 and Excel software. Subgroup analysis by profession was also performed.
Approval was obtained from participant stakeholders. All participants gave their written informed consent.
Results
The first round response rate was 100% (n = 10) and for the second round was 90% (n = 9). The number of criteria ranked during the first round were in total 25, distributed between positioning, parameters, sharpness/compression and artefacts, and were adapted to each projection. Additionally, 4 criteria to assess the implant itself in a mammographic examination were considered (Table 2).
- A.
Criteria to assess image quality of CC projections performed with Eklund manoeuvre performed in women with BI
Criteria classified as “need to have” were sharpness of glandular tissue, absence of artefacts with a degree of consensus of 80%; spread of breast tissue to differentiate adipose from fibroglandular tissue with a degree of consensus of 70%; nipple in profile, maximum retropulsion of breast implant, breast aligned to the detector, absence of skin folders and adequate contrast between anatomical structures with a degree of consensus of 60%. The visualisation of the medial border, retroglandular adipose tissue and axillary tail were considered as “nice to have” structures with a degree of consensus of 60%. The sharp reproduction of skin structure (rosettes from pores) was considered as not necessary (Table 3).
The CC images acquired without Eklund technique had an extra criterion: the absence of flow in the implant area and symmetrical (in mirror) CC images.
Between the first and second Delphi rounds, it was possible to exclude some criteria (Table 4) due to poor scoring attributed to them, namely visualisation of pores, visualisation of the pectoral muscle and vascular anatomy. Contrast and adequate radiation penetration of the breast tissues were suggested as relevant in the first round outcomes and so were introduced into the second round and ranked high amongst the criteria.
- B.
Criteria to assess image quality of standard MLO projections performed in women with BI
The most important criteria for MLO images were as follows: absence of artefacts with a degree of consensus of 78%; sharpness and spread of breast tissues, inframammary angle clearly demonstrated, full visualisation of inferior breast tissue and maximum visualisation of pectoral muscle, nipple on profile, breast aligned with the detector centre, with a degree of consensus of 67%.
The sharp reproduction of skin structure (rosettes from pores) and skin line visualisation were considered as not necessary.
Between the first and second Delphi rounds, some criteria were excluded as observed above for CC images (Table 5). One of criterion that became less relevant in the second round for images with BI was the level of visualisation of the pectoral muscle, namely the pectoral to nipple line (PNL). That criterion was left out of the questionnaire for the second round.
- C.
Criteria to assess image quality of ML projections performed with Eklund manoeuvre performed in women with BI
For ML images, the absence of artefacts, spread and sharp visualisation of breast tissues and breast aligned with the detector were considered as the most important parameters to be included in the analysis of ML images with a degree of consensus of 80%. The visualisation of superior and inferior breast tissues, the absence of skin folders and the maximum retropulsion of the implant to reduce the superimposition over breast tissue were other criteria highlighted as important with a degree of consensus of 60%. Adequate contrast and penetration were parameters not considered during the first Delphi round, but from the second round, these parameters were ranked in fifth and sixth positions (Tables 6 and 7).
Radiographers and radiologists did not agree in their ranking of 11 criteria for image quality assessment for the most common projections (CC and MLO) performed in women with BI (Figs. 1 and 2). The criteria considered as most relevant by radiographers to assess CC images were definition/sharpness of breast tissues, nipple in profile and spread of breast tissue. Radiologists noted the alignment of the breast with the detector’s centre as “need to have” as well as definition/sharpness of breast tissues. Radiographers considered it important in MLO views to visualise the inframammary angle and also the visibility of inferior tissues, while radiologists were looking for the absence of artefacts, nipple not superimposed over breast tissue, absence of skin folders and definition/sharpness of breast tissue.
Kendall’s coefficient of concordance was performed to verify the level of agreement between the two professional groups, and the differences were visible. The level of agreement between participants ranged from − 0.13 to 0.7 for craniocaudal image criteria and − 0.06 to 0.7 for MLO image criteria.
Discussion
The objectives of this study were to identify image quality criteria that are currently in use to assess BI mammograms according to radiologists and radiographers’ perspectives and to explore the level of agreement about criteria priority.
To achieve these objectives a search was performed to identify possible criteria adapted to this specific context; however, no guidance was found [34]. This gap can impact on radiographers and radiologists’ activities considering that is important to know what should be demonstrated on the image to select the most suitable protocol and to achieve examination goals. Not having a level of image quality that allows for the analysis of all relevant anatomy of the breast with implants means the diagnosis of breast pathologies can be compromised [48].
This study showed that the two professional groups look at BI mammograms in different ways, having individual strategies to assess IQ as demonstrated by the results of the Kendall concordance test. The agreement between radiographers and radiologists ranged from weak (− 0.13) to good agreement (0.7). Major differences in agreement were related to the priority of criteria, with radiographers searching for specific anatomical details (nipple in profile, visualisation of medial, superior and inferior breast tissues), while radiologists were focused on overall assessment such as contrast, breast aligned with the detector, beam penetration, spread and sharpness of breast tissue and absence of artefacts. In a study promoted by the Canadian Association of Radiologists [49], the problems related to the presence of artefacts in the image were emphasised as they can promote an increase in false positive rates compromising the diagnosis. On the other hand, another study stressed positioning deficiencies as the main causes of inadequate image quality. The presence of skin folds, the pectoral muscle being concave or thin or having a sagging breast on the MLO, or a portion of breast cut off were frequently highlighted [50]. However, having a BI means the relevance and priority of some criteria can vary compared to standard mammograms. For example, the visualisation and shape of pectoral muscle will change if a subglandular implant is placed inside the breast because the implant will be overlapping with the muscle. A portion of breast being cut off can also happen in this situation, due to the limitations in manipulating the implant when it is encapsulated [51] or even to include inframammary angle in MLO projections [34].
This study also showed that the priority of each criterion is different amongst the two professional groups, it being desirable to take into account the likelihood of attaining each criterion in further studies. Radiographers prioritise the aesthetic side while radiologists look to see if the relevant information is noted in the image or not [52]. Previous studies showed that is effectively important as an overall assessment of image quality [43, 52], it being crucial to have all breast tissues included and correctly demonstrated. However, the proposed strategies to assess mammograms were still considered subjective for some criteria, and the need for standardisation was highlighted [53]. The words “appropriate” and “general amount” are being used but they are open to individual interpretation bringing variations in the final IQ analysis. Additionally, BI are an extra challenge because there is a superimposition of a dense structure over soft breast tissues, increasing the possibility of hiding relevant pathologies [43]. For that reason, modified positioning is required (Eklund) to help with the reduction of the amount of breast tissue superimposition. This is managed by displacing the implant posteriorly against the chest wall and pulling breast tissue over and in front of the implant, facilitating also the compression [51]. But these changes in positioning bring concomitant changes in the image appearance, making it necessary that radiographers know exactly what is required to be demonstrated, and communicating with radiologists to achieve a better alignment between both. Education also has a role to play as revealed in a previous study about mammography education in Europe [54] which demonstrated that positioning and image quality assessment are very challenging, leading to students demanding more training and a wider exposure to different clinical scenarios. Specific training for BI imaging could be an approach that would reduce professional differences.
The main limitations of this study are related to a different number of participants in both rounds (first 10, second 9) and also the 2 groups of professionals were not the same size (6 radiographers and 4 radiologists), which may affect the subgroup analyses. ML view and Eklund manoeuvre were not currently performed by all participants and implant location (subglandular or subpectoral) was not considered, and that has an impact on the visible anatomy as demonstrated previously [34]. This means that during the ranking process the decision of the participants would not consider the changes in image.
Further research is required for the identification of quality targets that should be reached in daily practice. However, the risk of omitting indicators was mitigated by the expertise of the panel who were given the opportunity to suggest additional ones, considering they were familiar with the relevant literature and BI imaging. That is also one of the advantages of using the Delphi method, where opinions can be different from one round to another [52], making the list richer.
Even with published work showing that is possible to use the Delphi method to identify quality indicators and prioritise criteria to be included in guidelines, it was challenging to conduct this study. The lack of standardisation of definitions, number of participants, optimal variance of rating scale, the best means for each answer and image quality assessment methodologies can lead to an incomplete list of criteria to assess BI examinations.
Therefore, basic criteria to start the image analysis were identified for BI such as maximum retropulsion of implant, visualisation of anterior edge of implant and no artefacts (such as flow). But some criteria identified as necessary are still subjective and that can be considered a limitation of this study, for example, “adequate contrast” and “adequate beam penetration”.
Conclusions
Radiologists and radiographers did not consider the same parameters as relevant to assess image quality of BI mammograms; however, a list of criteria to assess BI mammograms was produced focusing on aspects of positioning, exposure parameters, sharpness and compression regarding the implant itself. This difference in the approach to image assessment shows that it is necessary to develop a standardised strategy in BI mammography, including different criteria adapted to each type of implant (subglandular versus subpectoral) as the changes promoted in the anatomy are different. Considering the experts’ opinions, the criteria to assess BI mammograms must consider maximum retropulsion of the implant, visualisation of the anterior edge of the implant and no artefacts (such as flow). The spread and sharpness of breast tissues are the other “need to have” parameters that do not differ from standard mammography. The revision of the PNL line and inclusion of the inframmamary angle criteria seem to be necessary to adapt to this specific context taking in consideration the implant location (subglandular/subpectoral).
Education and training to align radiographers and radiologists understandings is also necessary to have examination outcomes that match the interpretation requirements that lead to the optimal diagnostic outcomes of breast pathologies.
Availability of data and materials
Data generated or analysed during this study are included in this published article.
Abbreviations
- BCSP:
-
Breast cancer screening programs
- BI:
-
Breast implants
- CC:
-
Craniocaudal
- IQ:
-
Image quality
- ML:
-
Mediolateral
- MLO:
-
Mediolateral oblique
- PNL:
-
Pectoral to nipple line
- SPSS:
-
Statistical Package for the Social Sciences
References
The National Cancer Institute (2011) International Cancer Screening Network. In: Organ. Breast Cancer Screen. Programs 27 ICSN Countries, 2007-2008. http://appliedresearch.cancer.gov/icsn/breast/screening.html
Keating NL, Pace LE (2018) Breast cancer screening in 2018: time for shared decision making. JAMA 319:1814 https://doi.org/10.1001/jama.2018.3388
American College of Radiology Breats Implants Evaluation. In: Appropriateness Criteria - Am. Coll. Radiol. https://acsearch.acr.org/list/GetEvidence?TopicId=239&TopicName=Breast Implant Evaluation. Accessed 24 Jan 2019
Smalley S (2003) Breast implants and breast cancer screening. J Midwifery Womens Health 48:329–337. https://doi.org/10.1016/S1526-9523(03)00280-0
Bantick GL, Taggart I (1995) Mammography and breast implants. Br J Plast Surg 48:49–52. https://doi.org/10.1016/0007-1226(95)90032-2
Daskalaki A, Bliznakova K, Pallikarakis N (2016) Evaluation of the effect of silicone breast inserts on X-ray mammography and breast tomosynthesis images: a Monte Carlo simulation study. Phys Med 32:353–361 https://doi.org/10.1016/j.ejmp.2016.01.478
Raj SD, Karimova EJ, Fishman MDC et al (2017) Imaging of breast implant–associated complications and pathologic conditions: breast imaging. Radiographics 37:1603–1604 https://doi.org/10.1148/rg.2017170025
Juanpere S, Perez E, Huc O, Motos N, Pont J, Pedraza S (2011) Imaging of breast implants—a pictorial review. Insights Imaging 2:653–670 https://doi.org/10.1007/s13244-011-0122-3
Shah AT, Jankharia BB (2016) Imaging of common breast implants and implant-related complications: a pictorial essay. Indian J Radiol Imaging 26:216–225 https://doi.org/10.4103/0971-3026.184409
del Turco MR (2010) Implementation of the European Union Guidelines for quality assurance in breast cancer screening and diagnosis. In: Europa DONNA (ed) European Journal of Cancer Supplements. Elsevier Ltd, pp 189–189
EUSOMA - GUIDELINES AND PUBLICATIONS - Breast Unit Guidelines - Index. http://www.eusoma.org/Engx/Guidelines/Guideline.aspx?cont=breast. Accessed 26 Jan 2015
Kanal KM, Krupinski E, Berns EA et al (2013) ACR–AAPM–SIIM practice guideline for determinants of image quality in digital mammography. J Digit Imaging 26:10–25 https://doi.org/10.1007/s10278-012-9521-3
European Commission (1996) European guidelines on quality criteria for diagnostic radiographic images. European Communities, Luxembourg
Spuur K, Webb J, Poulos A, Nielsen S, Robinson W (2018) Mammography image quality and evidence based practice: analysis of the demonstration of the inframammary angle in the digital setting. Eur J Radiol 100:76–84 https://doi.org/10.1016/j.ejrad.2018.01.004
McIntosh SA, Horgan K (2008) Augmentation mammoplasty: effect on diagnosis of breast cancer. J Plast Reconstr Aesthet Surg 61:124–129 https://doi.org/10.1016/j.bjps.2007.06.035
Berry MG, Davies DM (2010) Breast augmentation: part i - a review of the silicone prosthesis. J Plast Reconstr Aesthet Surg 63:1761–1768 https://doi.org/10.1016/j.bjps.2009.07.047
Stöblen F, Rezai M, Kümmel S (2010) Imaging in patients with breast implants—results of the First International Breast (Implant) Conference 2009. Insights Imaging 1:93–97 https://doi.org/10.1007/s13244-010-0021-z
Lowes S, MacNeill F, Martin L et al (2018) Breast imaging for aesthetic surgery: British Society of Breast Radiology (BSBR), Association of Breast Surgery Great Britain & Ireland (ABS), British Association of Plastic Reconstructive and Aesthetic Surgeons (BAPRAS). J Plast Reconstr Aesthet Surg 71:1521–1531 https://doi.org/10.1016/j.bjps.2018.07.004
Moneme NC, Curtis J (2019) Radiographer mammographers’ attitudes towards implementing new techniques for imaging the augmented breast, after viewing a training DVD or receiving cascade training: a survey. Radiography (Lond) 25:39–45 https://doi.org/10.1016/j.radi.2018.07.006
Parr O, Dunmall K (2018) An evaluation of online information available for women with breast implants aged 47–73 who have been invited to attend the NHS Breast Screening Programme. Radiography (Lond) 24:315–327 https://doi.org/10.1016/j.radi.2018.03.008
Eklund GW, Busby RC, Miller SH, Job JS (1988) Improved Augmented imaging breast of the augmented breast. AJR Am J Roentgenol 151:469–473 https://doi.org/0361-803X/88/1513-0463
Uematsu T (2008) Screening and diagnosis of breast cancer in augmented women. Breast Cancer 15:159–164 https://doi.org/10.1007/s12282-008-0036-1
Bassetti E, Pediconi F, Luciani ML, Santucci E, Miglio E, Candreva R (2011) Breast prosthesis: management of patients after plastic surgery. J Ultrasound 14:113–121 https://doi.org/10.1016/j.jus.2011.03.001
Murphy C (2005) An overview of radiological technology in the management of breast cancer. Can J Med Radiat Technol 36:6–14. https://doi.org/10.1016/S0820-5930(09)60081-5
Beckett JR, Kotre CJ (2000) Estimation of mean glandular dose for mammography of augmented breasts. Phys Med Biol 45:3241–3252
Tuli R, Flynn RA, Brill KL, Sabol JL, Usuki KY, Rosenberg AL (2006) Diagnosis, treatment, and management of breast cancer in previously augmented women. Breast J 12:343–348 https://doi.org/10.1111/j.1075-122X.2006.00273.x
Silva FAR, Souza LF, Salmon CEG (2011) Breast phantom with silicomne implant for evaluation in conventional mammography. J Appl Clin Med Phys 12:199–206
Ganott MA, Harris KM, Ilkhanipour ZS, Costa-Greco MA (1992) Augmentation mammoplasty: normal and abnormal findings with mammography and US. Radiographics 12:281–295 https://doi.org/10.1148/radiographics.12.2.1561417
Stivala A, Rem K, Leuzzi S et al (2017) Efficacy of ultrasound, mammography and magnetic resonance imaging in detecting breast implant rupture: A retrospective study of 175 reconstructive and aesthetic sub-pectoral breast augmentation cases. J Plast Reconstr Aesthet Surg 70:1520–1526 https://doi.org/10.1016/j.bjps.2017.05.051
Kopans DB, Moore RH, Mccarthy KA et al (1997) Should women with implants or a history of treatment for breast cancer be excluded from mammography screening programs? AJR Am J Roentgenol 168:29–31 https://doi.org/0361-803X/97/1681-29
Kam K, Lee E, Pairawan S et al (2015) The effect of breast implants on mammogram outcomes. Am Surg 81:1053–1056 https://doi.org/10.1002/we.1770
Smathers RL, Boone JM, Lee LJ, Berns EA, Miller RA, Wright AM (2007) Radiation dose reduction for augmentation mammography. AJR Am J Roentgenol 188:1414–1421 https://doi.org/10.2214/AJR.06.0998
Silva FAR, Souza LF, Salmon CEG, Souza DN (2011) Breast phantom with silicone implant for evaluation in conventional mammography. J Appl Clin Med Phys 12:199–206 https://doi.org/10.1120/jacmp.v12i1.3340
Sá dos Reis C, Gremion I, Richli Meystre N (2020) Study of breast implants mammography examinations for identification of suitable image quality criteria. Insights Imaging 11:3 https://doi.org/10.1186/s13244-019-0816-5
Vernon W (2009) The Delphi technique: a review. Int J Ther Rehabil 16:69–76 https://doi.org/10.12968/ijtr.2009.16.2.38892
John-Matthews JS, Wallace MJ, Robinson L (2017) The Delphi technique in radiography education research. Radiography (Lond) 23:S53–S57 https://doi.org/10.1016/j.radi.2017.03.007
Mullen PM (2003) Delphi: myths and reality. J Health Organ Manag 17:37–52 https://doi.org/10.1108/14777260310469319
Keeney S, Hasson F, McKenna HP (2001) A critical review of the Delphi technique as a research methodology for nursing. Int J Nurs Stud 38:195–200. https://doi.org/10.1016/S0020-7489(00)00044-4
Lelivelt H, Ongeval C van, Jacobs J, et al (2010) EUREF type testing - clinical evaluation protocol. Nijmegen
European Communities/EUREF (2006) European guidelines for quality assurance in breast cancer screening and diagnosis, 4th ed. European Communities, Luxembourg
Nworie J (2011) Using the Delphi technique in educational technology research. TechTrends 55:24–30 https://doi.org/10.1007/s11528-011-0524-6
Gargon E, Crew R, Burnside G, Williamson PR (2019) Higher number of items associated with significantly lower response rates in COS Delphi surveys. J Clin Epidemiol 108:110–120 https://doi.org/10.1016/j.jclinepi.2018.12.010
Li Y, Poulos A, Mclean D, Rickard M (2010) A review of methods of clinical image quality evaluation in mammography. Eur J Radiol 74:122–131 https://doi.org/10.1016/j.ejrad.2009.04.069
Reis C, Pascoal A, Sakellaris T, Koutalonis M (2013) Quality assurance and quality control in mammography: a review of available guidance worldwide. Insights Imaging 4:539–553 https://doi.org/10.1007/s13244-013-0269-1
Meystre NR, Bulliard J-L (2011) Test et validation d’une grille d’évaluation dédiée à la mammographie. Fonds National Suisse de la Recherche Scientifique
European Commission, European Communities/European Reference Organisation for Quality Assured Breast Screening and Diagnostic Services (2006) European guidelines for quality assurance in breast cancer screening and diagnosis., 4th ed. European Communities, Brussels
Gisev N, Bell JS, Chen TF (2013) Interrater agreement and interrater reliability: key concepts, approaches, and applications. Res Soc Adm Pharm 9:330–338 https://doi.org/10.1016/j.sapharm.2012.04.004
Dumky H, Leifland K, Fridell K (2018) The art of mammography with respect to positioning and compression—a Swedish perspective. J Radiol Nurs 37:41–48 https://doi.org/10.1016/j.jradnu.2017.11.006
Guertin MH, Théberge I, Zomahoun HT, Dufresne MP, Pelletier É, Brisson J (2018) Mammography clinical image quality and the false positive rate in a Canadian breast cancer screening program. Can Assoc Radiol J 69:169–175 https://doi.org/10.1016/j.carj.2017.12.003
Guertin M-H, Théberge I, Dufresne M-P et al (2014) Clinical image quality in daily practice of breast cancer mammography screening. Can Assoc Radiol J 65:199–206 https://doi.org/10.1016/j.carj.2014.02.001
Eklund G, Busby R, Miller S, Job J (1988) Improved imaging of the augmented breast. AJR Am J Roentgenol 151:469–473 https://doi.org/10.2214/ajr.151.3.469
Taylor K, Parashar D, Bouverat G et al (2017) Mammographic image quality in relation to positioning of the breast: a multicentre international evaluation of the assessment systems currently used, to provide an evidence base for establishing a standardised method of assessment. Radiography (Lond) 23:343–349 https://doi.org/10.1016/j.radi.2017.03.004
Hill C, Robinson L (2015) Mammography image assessment; validity and reliability of current scheme. Radiography (Lond) 21:304–307 https://doi.org/10.1016/j.radi.2015.07.005
Sá dos Reis C, Strøm B, Richli-Meystre N et al (2018) Characterization of breast imaging education and insights from students, radiographers and teaching staff about its strengths, difficulties and needs. Radiography (Lond) 25:e1–e10 https://doi.org/10.1016/j.radi.2018.07.001
Acknowledgements
The authors would like to acknowledge the experts (radiographers and radiologists) who participated on Delphi data collection and contributed to the discussions about image quality criteria that should be added to evaluate breast implant mammograms.
Funding
Haute école Spécialisée de Suisse Occidentale (SAGE-X n66636)
Author information
Authors and Affiliations
Contributions
All authors contributed to this work. CSR made contributions to the conception and design of the study and data analysis and substantively revised it. IG made contributions to the design and data collection and revised. NRM made substantial contributions to the conception and design of the study and analysis of the data and substantively revised it. All authors read and approved the final manuscript. All authors agree with the publication and they gave consent to publish this work.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Ethical approval and consents to participate were obtained from participant institutions and from the Ethical Board of Swiss Ethics Committees on Research.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Sá dos Reis, C., Gremion, I. & Richli Meystre, N. Consensus about image quality assessment criteria of breast implants mammography using Delphi method with radiographers and radiologists. Insights Imaging 11, 56 (2020). https://doi.org/10.1186/s13244-020-00860-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13244-020-00860-z