Summary of Results External Quality Assessment of Water Microbiology
Bottled and Mineral Water Scheme Distribution Number: BMW18
Sample Numbers: BMW18A, BMW18B
Distribution Date: Results Due: Report Date:
January 2018 23 February 2018 02 March 2018
Samples prepared and quality control tested by:
Angela Appea Richard Borrill Thomas Harper Zak Prior Judith Spellar Aneta Stranc Lili Tsegaye
Data analysed by:
Nita Patel Manchari Rajkumar
Report compiled by:
Nita Patel Manchari Rajkumar
Authorised by:
Nita Patel
This report must not be reproduced without permission of the organisers. Public Health England Food and Environmental Proficiency Testing Unit (FEPTU) 61 Colindale Avenue London NW9 5EQ Tel: +44 (0)20 8327 7119 Fax: +44 (0)20 8200 8264 Email:
[email protected] The data in FEPTU reports is confidential
Page 1 of 11
Printed at 15:12 on Friday, 2 March, 2018
For further information about the scheme please refer to: Scheme Guide: https://www.gov.uk/government/publications/food-and-water-proficiency-testing-schemes-scheme-guide Guide to Scoring and Statistics: https://www.gov.uk/government/publications/food-and-water-proficiency-testing-schemes-scoring-systems-and-statistics
General guidance for z-scores: Participants' enumeration results are converted into z-scores using the following formula:
Z = (xi-Xpt) σpt
xi Xpt
= participants' result expressed (expressed as a log 10 value) = assigned value (participants' consensus median (expressed as a log 10 value))
σpt
= the fixed standard deviation for the examination (calculated by FEPTU)
The σpt-value expresses the acceptable difference between the individual participant 's result and the participants' consensus median. The σpt-value used for calculating z-scores for all parameters in the Bottled and Mineral Water Scheme is 0.35. A guide to interpreting z-scores follows, although laboratories must interpret their scores in the context of their own laboratory situation. z = -1.99 to +1.99 z = -2 to -2.99 or +2 to +2.99 z= < -3.00 or > + 3.00
satisfactory questionable unsatisfactory
It is usually recommended that z-scores exceeding +/-2 are investigated to establish the possible cause. general rule, PHE recommends that all questionable and unsatisfactory results are investigated.
As a
FEPTU Quality Control: To demonstrate homogeneity of the sample, a minimum of 10 LENTICULE® discs , selected randomly from a batch, are tested in duplicate for parameters requiring enumeration.
To demonstrate stability of the sample, a minimum of nine LENTICULE discs, selected randomly from a batch, are examined throughout the distribution period for enumeration parameters. Public Health England uses methods stipulated in The Natural Mineral Water, Spring Water and Bottled Drinking Water (England) Regulations (2007) as amended. The FEPTU results are used for guidance in the preliminary intended results notification, letters are posted on the website immediately after every distribution; electronic notification of their availability is sent to all participants. Refer to section 17.0 of the Scheme Guide if you have experienced difficulties with any of the examinations . https://www.gov.uk/government/publications/food-and-water-proficiency-testing-schemes-scheme-guide
Participants are reminded that reporting an incorrect or false negative results could have serious public health implications. Participants who report unexpectedly high or low results for enumerations on single occasions only should not be unduly alarmed, although they should still assess the reason(s) for the outlying result. The results, as summarised in the performance assessment sheet included in this report, provide a more effective indication of on-going problems with the enumeration of low levels of indicator organisms in bottled and mineral water samples. Performance assessment cannot be undertaken as effectively if laboratories do not participate in all distributions for the Bottled and Mineral Water Scheme.
Please contact FEPTU staff for advice and information: Repeat samples
Carmen Gomes or Kermin Daruwalla
Data Analysis
Manchari Rajkumar or Nita Patel
Microbiological advice
Nita Patel or Zak Prior
Tel: Fax: Email:
General comments and complaints
Nita Patel or Zak Prior
FEPTU's website
Scheme consultants
Julie E. Russell
Scheme Co-ordinator
Nita Patel
+44 (0)20 8327 7119 +44 (0)20 8200 8264
[email protected] Accreditation: PHE Water EQA Scheme for Bottled and Mineral Water is accredited by the United Kingdom Accreditation Service (UKAS) to ISO/IEC 17043:2010.
0006 The data in FEPTU reports is confidential
Page 2 of 11
Printed at 15:12 on Friday, 2 March, 2018
Sample: BMW18A Contents: Enterococcus faecium, Pseudomonas aeruginosa, Clostridium perfringens, Staphylococcus hominis
Expected Results: All counts are expressed as colony forming units (cfu) in 250mL except sporulated sulphite-reducing anaerobes which is in 50 mL and the colony counts at 37ºC/24h and 22ºC/72h which are cfu per mL. The fixed standard deviation value (σpt value) used for calculation of the z-scores is 0.35 for all parameters.
Coliform bacteria
E.coli
Enterococci
P.aeruginosa
Sporulated sulphite-reducing anaerobes
Colony count 37ºC/24h
Colony count 22ºC/72h
0
0
78
25
103
69
27
46
46
46
46
40
47
44
0
0
76
11
89
61
16
N/A
N/A
0.02
0.08
0.03
0.05
0.06
0
0
77
11
86
54
17
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
Expected Range
N/A
N/A
1 - 240
1 - 33
12 - 281
15 - 193
1 - 58
Standard
N/A
N/A
0.09
0.38
0.17
0.25
0.35
N/A
N/A
6
5
4
5
11
False positives
2
1
N/A
N/A
N/A
N/A
N/A
False negatives
N/A
N/A
6
4
0
1
6
Parameter
FEPTU median
No. results returned
Assigned value (Participants median all results) Uncertainty of assigned value*
Participants mean (all results)
Participants median (MPN only)
Participants median (MF only)
deviation**
No of outlying counts
Your result
Score for performance assessment Z-score
*
U (Xpt) is based on results transformed to a log₁₀ scale
**
Robust S* based on median absolute deviation about the participants' median (MADe)
Total sent samples
52
Not examined
3
Non returns
1
The data in FEPTU reports is confidential
Page 3 of 11
Printed at 15:12 on Friday, 2 March, 2018
Sample: BMW18B Contents: Escherichia coli, Klebsiella pneumoniae, Enterococcus faecalis, Pseudomonas aeruginosa, Clostridium bifermentans, Kocuria kristinae
Expected Results: All counts are expressed as colony forming units (cfu) in 250mL except sporulated sulphite-reducing anaerobes which is in 50 mL and the colony counts at 37ºC/24h and 22ºC/72h which are cfu per mL. The fixed standard deviation value (σpt value) used for calculation of the z-scores is 0.35 for all parameters.
Coliform bacteria
E.coli
Enterococci
P.aeruginosa
Sporulated sulphite-reducing anaerobes
Colony count 37ºC/24h
Colony count 22ºC/72h
FEPTU median
50
29
95
24
76
64
77
No. results returned
46
46
46
46
40
47
44
Assigned value
54
32
97
13
86
73
66
0.01
0.03
0.01
0.06
0.07
0.02
0.03
53
30
96
15
74
71
63
N/A
N/A
N/A
N/A
N/A
N/A
N/A
55 (n=39)
30 (n=39)
N/A
N/A
N/A
N/A
N/A
17 - 171
10 - 100
31 - 305
1 - 40
9 - 272
23 - 231
21 - 207
0.09
0.15
0.05
0.3
0.26
0.12
0.16
3
3
1
10
0
3
3
False positives
N/A
N/A
N/A
N/A
N/A
N/A
N/A
False negatives
1
2
0
10
18
1
2
Parameter
(Participants median all results) Uncertainty of assigned value*
Participants mean (all results)
Participants median (MPN only)
Participants median (MF only)
Expected Range
Standard deviation**
No of outlying counts
Your result
Score for performance assessment Z-score
*
U (Xpt) is based on results transformed to a log₁₀ scale
**
Robust S* based on median absolute deviation about the participants' median (MADe)
Total sent samples
52
Not examined
3
Non returns
1
The data in FEPTU reports is confidential
Page 4 of 11
Printed at 15:12 on Friday, 2 March, 2018
Performance Assessment Sheet Distribution
Sample
BMW18
BMW18A
Coliform bacteria score
Escherichia coli score
Enterococci score
Pseudomonas aeruginosa score
Sporulated sulphite-reducing anaerobes
Colony Count 37ºC/24 h score
Colony Count 22ºC/72 h score
BMW18B BMW17
BMW17A BMW17B
BMW16
BMW16A BMW16B
Total maximum possible score Total percentage
Performance Assessment Comment:
Overall Performance Assessment for Distributions BMW16, BMW17, BMW18
Participants are reminded that to take advantage of the performance assessment overtime tool provided in the reports they need to take
30
100
90-99
80-89
70-79
60-69
50-59
40-49
30-39
20-29
0
10-19
Your overall performance with the enumerations of low levels of indicator organisms in Bottled and Mineral Water proficiency testing samples for the current and the previous two distributions are collated in the chart to the right.
10
1-9
Cumulative scores are calculated for the current and the previous two distributions for the Bottled and Mineral Water Scheme. Participants' cummulative scores for each of the examinations are compared with the maximum possible scores after every distribution.
20
0
Performance assessments are designed to alert participants to on-going problems with their examinations and are provided after every distribution. Scores are allocated to results reported for every parameter, for every sample to help assess performance.
Number of participants
part in more than one distribution a year.
Percentage achieved of max possible score for stipulated distributions
Performance Assessment Comment: Laboratories that achieve less than 70% of the maximum possible score are likely to be experiencing significant problems with their examinations and are advised to: a) refer to the relevant distribution reports for sample-specific comments b) refer to the website guidance documents: https://www.gov.uk/government/collections/external-quality-assessment-eqa-and-proficiency-testing-pt-for-food-water-and-environ mental-microbiology
c) contact the organisers for advice
The data in FEPTU reports is confidential
Page 5 of 11
Printed at 15:12 on Friday, 2 March, 2018
0
The data in FEPTU reports is confidential
10
No. of Results
89 Participant Median
103 FEPTU Median
Outlying results
2 0
25
15
20
15
10
5
5
0
1
61 Participant Median
Count per 50mL
Page 6 of 11 69 FEPTU Median
Outlying results
25 FEPTU Median
Outlying results
2
2 >33
30-33
28-29
26-27
24-25
22-23
20-21
18-19
16-17
14-15
12-13
11 Participant Median
>193
174-193
164-173
154-163
144-153
134-143
124-133
114-123
104-113
94-103
10-11
8-9
6-7
0
84-93
74-83
Count per 250mL
64-73
5-5
4-4
3-3
2-2
Outlying results
No data for graph
54-63
44-53
35-43
26-34
0
15-25
PHE score 30
Outlying results
BMW18A: Sporulated sulphite-reducing anaerobes 0 281
252-281
237-251
222-236
207-221
192-206
177-191
162-176
147-161
132-146
40
35-40
33-34
31-32
29-30
27-28
25-26
23-24
21-22
19-20
41-45
36-40
31-35
27-30
23-26
19-22
15-18
Outlying results
32 Participant Median
>231
208-231
196-207
184-195
172-183
160-171
148-159
136-147
124-135
113-123
0
17-18
15-16