World Health Organization EVM Assistant User guide

WHO/IVB/09.XX

ORIGINAL: ENGLISH

Module <>

The EVM assistant user guide

Version v3

Sep 2010

EVM— setting a standard for the vaccine supply chain

Contents

Technical terms and acronyms .............................................................................. 4

Acknowledgements................................................................................................. 5

Introduction ............................................................................................................. 6

1.

Numerical indicators ....................................................................................... 7

1.1

Indicators requiring the EVM Assistant and/or field data collection............. 7

2.

Calculation methods ....................................................................................... 9

2.1

Collecting basic data.................................................................................. 9

2.1.1

Immunization schedule data............................................................... 9

2.1.2

Stock management data .................................................................. 11

3.

Organization of the EVM Assistant .............................................................. 13

4.

User instructions ........................................................................................... 14

4.1

How to start the tool ................................................................................. 14

4.2

How to generate the nomograms ............................................................. 15

4.2.1

Vaccine_select worksheet ................................................................ 15

4.2.2

Nomo_data worksheet ..................................................................... 16

4.2.3

Facility_table worksheet ................................................................... 19

4.2.4

Reference data worksheets.............................................................. 20

A.

Vaccine_database sheet:......................................................................... 20

B.

PQEquipment sheet:................................................................................ 20

C.

Passive_Containers sheet: ...................................................................... 20

D.

Waterpacks sheet .................................................................................... 20

E.

Worksheet_A ........................................................................................... 20

F.

Worksheet_B ........................................................................................... 20

5.

Field measurements and manual calculations ............................................ 22

5.1

Measuring net storage capacity ............................................................... 22

5.1.1

Calculation method for cold stores and dry stores with shelving....... 22

5.1.2

Calculate method for PIS/PQS pre-qualified refrigerators and freezers

24

5.1.3

Calculation for non PIS/PQS pre-qualified refrigerators and freezers 24

5.1.4

Calculation method for cold stores and dry stores using pallets ....... 25

5.2

Measuring icepack or cool water pack capacity ....................................... 27

5.3

Measuring the capacity of cold boxes and passive containers ................. 28

5.4

Measuring transport capacity ................................................................... 28

5.5

Compliance with safety stock and maximum stock levels......................... 29

6.

How to read and use the nomograms .......................................................... 31

6.1

Scenario 1 – National vaccine store......................................................... 31

6.2

Scenario 2 – Provincial store ................................................................... 32

6.3

Other nomograms .................................................................................... 33

Annex 1: Nomogram example for storage at -20°C............................................. 34

Annex 2: Nomogram example – all vaccines at +5°C ......................................... 35

Annex 3: Nomogram example for dry store ........................................................ 36

Annex 4: Nomogram example for transport capacity......................................... 37

01072010-EVM-assistant-E-V3.doc 2 of 44 01 Sep 2010

Annex 5: Nomogram example for passive containers........................................ 38

Annex 6: Nomogram example for water-pack freezing capacity ....................... 39

Annex 7: Passive container lookup table ............................................................ 40

Annex 9: Worksheet A .......................................................................................... 42

Annex 10: Worksheet B ........................................................................................ 43

Revision history .................................................................................................... 44

01072010-EVM-assistant-E-V3.doc 3 of 44 01 Sep 2010

Technical terms and acronyms

The following technical terms and acronyms are used in the tool:

EEFO

EVM

Earliest Expiry date First Out

Effective Vaccine Management.

FIC

FOB

Fully Immunized Child

Free On Board (Incoterm). A standard way of expressing price information, used in the equipment data tables.

Primary store A store which receives some or all of its vaccine directly from a national or international vaccine manufacturer. Example: a national vaccine store.

Lowest delivery level store

MaxiStock

A store which receives vaccine from a higher level store ( sub-national ) and supplies one or more primary service delivery points.

Example: a district store supplying one or more health facilities. or

The maximum volume of a product or mix of products that will be held in stock or transported based on a defined delivery frequency.

Includes 25% safety stock.

Maximum storage volume

As MaxiStock.

Net storage volume

Passive container

Population

For a freezer, refrigerator or cold box: the actual volume available for the storage of vaccine.

A cold box, vaccine carrier or other device which is used to transport vaccine at the correct temperature without use of a power source.

The total population of a country.

Pre-qualified Cold chain equipment which has been pre-qualified by WHO for purchase by UN agencies.

Recipient

Service delivery level

An individual member of the target group for a specific vaccine.

A health facility or health post where vaccine is administered.

Sub-national store

A store which receives vaccine from a primary store or a higher level sub-national store and supplies one or more lower level sub-national store and/or one or more lowest delivery level stores. For example, a provincial store supplying one or more district stores.

Target group Subset of the population who are the target for receiving one or more of the vaccines in the immunization schedule. Expressed as a percentage of the total population.

Wastage factor

1/wastage rate.

Wastage rate Expected percentage of a vaccine vial that is wasted. In this application it includes both unopened and opened vial wastage.

01072010-EVM-assistant-E-V3.doc 4 of 44 01 Sep 2010

Acknowledgements

The EVM Assistant and its user guide have been developed by the Effective Vaccine

Management team as part of a joint project supported by the Optimize project and

WHO HQ, IVB/EPI. The tool and guide were written by Hailu Makonnen Kenea,

Souleymane Kone and Modibo Dicko from WHO HQ and by Andrew Garnett, a consultant to Project Optimize. The authors would like to thank Optimize project staff and immunization partners from UNCEF, PATH and IMP for their invaluable contributions.

01072010-EVM-assistant-E-V3.doc 5 of 44 01 Sep 2010

Introduction

The scoring of several of the EVM indicators involves collecting and processing numerical data. This needs to be done in a standardized way to ensure that assessors achieve consistent results.

The Excel-based EVM Assistant tool described in this document is a component of the EVM package. The tool can be downloaded from the EVM website.

This document tells you how to use the tool to answer the relevant EVM indicators.

The indicator references relate to the first release of the EVM offline application tool.

The document also describes how to do simple manual calculations for those numerical indicators for which the EVM Assistant does not provide direct assistance.

01072010-EVM-assistant-E-V3.doc 6 of 44 01 Sep 2010

1. Numerical indicators

Several of the EVM indicators require the assessor to perform calculations and to enter the calculated values in the EVM assessment tool. This section lists these indicators. It identifies which ones are supported by the EVM Assistant, which ones use field data on its own, and which ones require a combination of both field data and the use of the Assistant.

1.1 Indicators requiring the EVM Assistant and/or field data collection

The tables below list all the EVM indicators that require numerical data and describe where to look for this information.

Indicators in Tables 1 and 2, highlighted in pink, are supported by a calculation using the EVM Assistant

The ‘field data’ listed in Tables 1 and 2 are established either by simple calculation using a paper-based data collection form, or from a lookup table – for example a table showing the capacity of commonly used vaccine refrigerators. These field data calculation and lookup methods are described in more detail in Section 6.

Table 1: Criterion E3 – Cold storage, dry storage and transport capacity

Question no. EVM Question

E3:01a A Measure the net storage capacity of the +2°C to + 8°C store(s) in litres or m³

E3:01a B Enter maximum estimated vaccine volume in litres or m³, plus 10%.

E3:02a B Measure the net storage capacity of the -20°C store(s) in litres or m³

Use

Field data &

EVM Assistant

EVM Assistant

Field data &

EVM Assistant

E3:02a C Enter maximum estimated vaccine volume in litres or m³, plus 10%.

E3:03a A Measure the net storage capacity of the dry store in litres or m³

EVM Assistant

Field data &

EVM Assistant

E3:03a B Enter maximum estimated diluents, syringe and safety box volumes litres or m³, plus 10%.

EVM Assistant

E3:05a A Supplementary vaccines - Measure the net storage capacity of the +2°C to + 8°C store(s) in litres or m³

E3:05a B Supplementary vaccines - Enter maximum estimated vaccine volume for +2°C to + 8°C in litres or m³, plus 10%.

Field data &

EVM Assistant

Field data

(1)

E3:06a B Supplementary vaccines - Measure the net storage capacity of the -20°C store(s) in litres or m³

E3:06a C Supplementary vaccines - Enter maximum estimated vaccine volume for -20°C store(s) in litres or m³, plus 10%.

Field data &

EVM Assistant

Field data

(1)

E3:07a A Supplementary vaccines - Measure the net storage capacity of the dry store in litres or m³

Field data &

EVM Assistant

Field data

(1)

E3:07a B Supplementary vaccines - Enter maximum estimated diluents, syringe and safety box volumes litres or m³, plus

10%

E3:08a A Measure the net storage capacity of the delivery vehicle(s) in litres or m³

Field data

(2)

E3:08a B Enter peak delivery volume in litres or m³, plus 10%. EVM Assistant

01072010-EVM-assistant-E-V3.doc 7 of 44 01 Sep 2010

Question no. EVM Question

E3:09a A Is there sufficient freezing or cooling capacity to meet maximum demand? [Y, N]

E3:09a B Is there sufficient storage capacity for icepacks/chilled water packs storage to meet peak demand?

E3:10a B Are there sufficient passive containers? [Y, N]

Use

EVM Assistant

& field data

Field data &

EVM Assistant

EVM Assistant

& field data

Notes:

(1) Supplementary immunization activities in most countries are irregular. The amount of temporary storage and transport capacity required for these activities will be difficult to assess at the time of visit.

These indicators should be discussed with the store staff and checked objectively by manual calculation.

If supplementary vaccines are kept together with routine vaccines, the evaluation will take into consideration during analysis of adequacy of storage capacity for all vaccines kept in the store. This case is valid for diluents, syringes and safety boxes.

(2) Transport capacity is also difficult to assess precisely at time of visit. First identify the type of transport used and the way how vaccines are packed for transportation. Vaccines may be transported using cold boxes, big containers, pallets or in a refrigerated truck. Again, this indicator should be discussed with the store staff and checked objectively by manual calculation.

(3) In order to accommodate fluctuations in supply and demand, EVM expects storage and transport capacities to be at least 10% greater than the estimated volumes.

Table 2: Criterion E6 – Stock management system

Question No. EVM Question

E6:Q20a D During the review period, did the stock of each and every vaccine remain within its EVM recommended maximum?

[Y, N]

Source

Field data

(1)

&

EVM Assistant

E6:Q21a E During the review period, did the stock of each and every vaccine remain within its EVM recommended minimum? [Y,

N].

Field data

(1)

&

EVM Assistant

Notes:

(1) In order to accommodate fluctuations in supply and demand, EVM expects maximum and minimum stock levels to fluctuate by up to 10% above or below established maximum and minimum stock levels.

Fluctuations outside these ranges indicate poor stock management practice.

01072010-EVM-assistant-E-V3.doc 8 of 44 01 Sep 2010

2. Calculation methods

Several of the EVM indicators require the assessor to calculate available net storage and transport capacity in a store and to compare this with the actual quantity of vaccines and other supplies passing through the store. These indicators are shown above in Table 1.

The EVM Assistant approaches this problem as a four step process:

1. STEP 1 – Establish vaccine and commodity volumes: Before the field assessments start, the team leader will collect data on the immunization schedule, vaccine presentations, delivery intervals, etc and the range of target populations served by each type of facility to be visited. These data are then entered into the EVM Assistant to generate a series of nomograms which can be printed out and taken to the field. An alternative tabular format is also provided.

2. STEP 2 – Establish available storage capacity at each facility: Lookup tables and paper-based calculation forms are provided in the tool so that the assessor can calculate available net storage volumes based on field measurement and/or observation. For example, after identifying and recording the number and type of vaccine refrigerator in a store, the assessor will use the refrigerator and freezer lookup table provided to establish available net storage capacity. Similarly, the cold room data recording form (Worksheet A) will be used to record key measurements and then to calculate the net storage capacity of each room in a consistent way.

3. STEP 3 – compare vaccine and commodity volumes with available capacity:

Discussions at local level will help to establish the actual target population served by each of the visited facilities. By using these locally-sourced data, the nomograms in the EVM Assistant can be used for a rapid paper-based assessment of the maximum vaccine and commodity volumes passing through each store. Alternatively the tabular format can be used.

4. STEP 4 – complete the EVM assessment tool: Enter the calculated net storage capacity and maximum vaccine and injection equipment volumes in the EVM assessment tool to obtain the final score against the relevant indicators.

By using these simple methods, field assessors can do on-the-spot calculations which can also be shared and discussed with storekeeping staff at the time of the assessment.

The remainder of this section describes the basic data needed to generate the nomograms and how the data are collected at national level. Section 7 shows how the nomograms are used.

2.1 Collecting basic data

The data required to generate the nomograms should generally be available at national level. This section lists the data that has to be collected.

2.1.1 Immunization schedule data

Table 3 shows the data needed to generate the net maximum storage volumes required per recipient for vaccines, diluents, syringes and safety boxes.

01072010-EVM-assistant-E-V3.doc 9 of 44 01 Sep 2010

Table 3: Immunization schedule data for the net storage volume estimates

Name Description

Vaccine type

Vaccine presentation Number of doses per vial, Uniject™, pre-filled syringe, etc.

Packed volume per dose based on national figure

Optional: Indicate the packed volumes as per national figures if exist.

If left blank, the Maxi packed volume will be generated automatically using figures from the database in the EVM Assistant.

Vaccine wastage rate Optional: Indicate the national expected vaccine wastage rates. This will override the WHO/GAVI indicative figure. If no national figure is available, leave blank; the WHO/GAVI indicative figure will be generated automatically from the database in the EVM Assistant.

Target groups

List of all vaccines in the current immunization schedule. If the assessment is also going to review the introduction of new vaccine(s), list the new vaccine(s) and identify which, if any, of the existing vaccines will be replaced.

Expressed either as annual births or as percentage of the total population. (e.g. % that are children from 0-11 months; % that are eligible for HPV, TT, etc.). If the selection is annual birth there is no need of enter the % eligible. If the selection is % of the total population, the % for each vaccine is required.

As set out in the immunization schedule. Number of doses per recipient

MaxiStock established for primary level

The MaxiStock that is established for each vaccine received at national level. This figure is expressed in months of supply.

Table 4: Example of an immunization schedule data table

Vaccine type

Presentation

(doses/vial or pre-filled)

Packed volume per dose/cm

3

Wastage rate (%)

Existing schedule

BCG

OPV

DTP

HepB

Measles

TT

YF

New schedule

BCG

OPV

Measles

HepB (2)

DTP-

HepB-

Hib (3)

TT

YF

Rota (3)

20

10

10

10

10

10

5

20

10

10

Uniject

Pre-filled (1)

10 database database database database database database database database database database database

25.0 database

5 database

Pre-filled database

50

25

40

5

5

25

10

5

50

25

25

25

40

25

10

Recipient group

(% of population)

4.0

3.7

3.7

3.7

3.7

4.2

3.7

4.0

3.7

3.7

4.0

3.7

4.2

3.7

3.7

Doses per target group

MaxiStock at national level in months

1

2

1

1

4

3

3

1

4

1

1

3

2

1

1

9

9

9

9

9

9

9

9

9

9

6

6

4

4

4

(1) This gives an example of a vaccine that is not recorded in the database.

(2) Existing vaccine in new presentation for birth dose.

(3) New vaccine added to the schedule

01072010-EVM-assistant-E-V3.doc 10 of 44 01 Sep 2010

2.1.2 Stock management data

The stock management data listed in Table 5 are also required to generate the nomograms that will be used by field assessors at each of the four different store types – primary, sub-national, lowest delivery level and service delivery level.

Table 5: Stock management data for the net storage volume estimates

Name

Type of immunization schedule used

Description

The EVM Assistant uses either the current or the future immunization schedule option, depending on the purpose of the analysis. EVM Criteria 1-

9 do require the current immunization schedule. Use the future immunization schedule if you want to assess whether existing storage capacity can accommodate the addition of planned new vaccines.

Type of population used for analysis

The tool uses either the annual birth or a target group percentage for each vaccine. This approach gives the flexibility needed for newer vaccines, such as HPV, where the eligible target group covers a wide age range, or is limited to one sex.

A. Storage level - Polio is kept at -20

°

C and all other vaccines are kept at +5

°

C (1)

Minimum population size 1

Maximum population size 1

Establish the size of the target population served by the store that has the smallest catchment population (generally a sub-national store).

This figure is used to set the minimum value of the X-axis on the nomogram.

Establish the size of the target population served by the store that has the largest catchment population (generally a primary store).

This figure is used to set the maximum value of the X-axis on the nomogram.

Maximum stock: option 1

At primary level use the ‘per individual vaccine’ option. Otherwise, list up to four possible maximum stock level options, in months – for example 3,

4, 6 and 9 months. A graph will be generated for each of these choices.

B. Storage and service delivery levels - All vaccines are kept at +5

°

C (1)

Minimum population size 2

Establish the size of the target population served by the store that has the smallest catchment population (generally a health facility).

This figure is used to set the minimum value of the X-axis on the nomogram

Maximum population size 2

Maximum stock: option 2

Establish the size of the target population served by the store that has the largest catchment population (generally a lowest delivery level store).

This figure is used to set the maximum value of the X-axis on the nomogram.

List up to four possible maximum stock level options, in months – for example 1, 1.5, 2 and 3 months. A graph will be generated for each of these choices.

C. Dry storage capacity for diluents, syringes and safety boxes (1)

Storage options Select the option that matches the facility based on how supplies are stored: (a) Diluents are stored separately; (b) Syringes and safety boxes only are stored together or (c) All are stored together.

Minimum population size 3

Maximum population size 3

Establish the size of the target population served by the store that has the smallest catchment population. This figure is used to set the minimum value of the X-axis on the dry store nomogram.

Establish the size of the target population served by the store that has the largest catchment population (generally a primary store). This figure is used to set the maximum value of the X-axis on the dry store nomogram.

Maximum stock: options 3

List up to four possible maximum stock level options, in months – for example 1, 2, 3 and 4 months. A graph will be generated for each of these choices.

D. Delivery of vaccines, diluents, syringes and safety boxes (1)

Delivery options Select the option that matches the delivery system used: (a) vaccines and diluents are distributed separately from syringes and safety boxes; (b) vaccine and diluents and distributed together with syringes and safety boxes. Enter up to four possible shipment frequencies per year for vaccine-

01072010-EVM-assistant-E-V3.doc 11 of 44 01 Sep 2010

Name

Cold Box(CB)

Vaccine Carrier

(VC) category

Icepack type used

Minimum population size 4

Description diluents and syringes-safety boxes. A graph will be generated for each of these choices.

Select the CB or VC category that meet the delivery. (a) CB large; (b) CB small; (c) VC large; and (d) VC small.

Select Icepack type used: (a) 0,3; (b) 0.4; (c) o,6 ; (d) Average

Maximum population size 4

Frequency of shipments

Establish the size of the target population served by the store that has the smallest catchment population (generally a lowest delivery level store).

This figure is used to set the minimum value of the X-axis on the transport nomogram.

Establish the size of the target population served by the store that has the largest catchment population (generally a primary store).

This figure is used to set the maximum value of the X-axis on the transport nomogram.

List up to four possible shipment frequencies per year – for example, 4, 6 and 12. A graph will be generated for each of these choices.

(1) Sample is all the sites selected for EVM assessment.

Table 6: Example of a stock management data table

Data type

Unit of measurement

Value

Immunization schedule Text Select current or new

Type of population used for analysis Text Percentage of population in the target group.

A. National and sub-national storage where polio is kept at -20

°

C

Minimum population size 1 Number 50,000

Maximum population size 1 Number 100,000

Maximum stock options 1 Months ‘per individual vaccine’, 3, 4, 6 months

B. Lowest delivery and service delivery level storage – all vaccines are kept at +5

°

C

Minimum population size 2

Maximum population size 2

Maximum stock options 2

Number

Number

Months

500

20,000

1.5, 2, 4 months

C. Dry storage capacity for diluents, syringes and safety boxes

Minimum population size 3 Number 50,000

Maximum population size 3

Maximum stock options 3

Number

Months

100,000

4, 6, 9, 12 months

D. Delivery of vaccines, diluents, syringes and safety boxes

Minimum population size 4 Number 50,000

Maximum population size 4

Frequency of shipments

Number

Months

100,000

1, 3, 6, 12 months

N.B. Use tables 3-5 for description and tips where to find the data. This form will be used to collect secondary data for the EVM Assistant

01072010-EVM-assistant-E-V3.doc 12 of 44 01 Sep 2010

3. Organization of the EVM Assistant

This section outlines the components of the EVM Assistant. The tool is an Excel workbook divided into 22 worksheets

1

.

The Index worksheet provides basic instructions and includes a hyperlinked index to the individual worksheets. These worksheets are divided into three categories:

1. Data input sheets: Data entry is only required on the four worksheets named

Cover, Vaccine_select, Nomo_data and Facility_table. Cells that require mandatory data entry are coloured white and cells that allow optional data entry are coloured pale yellow. All other cells are protected. Protected cells containing formulae are coloured pale green or grey.

2. Output data sheets: These make use of the input data to generate countryspecific lookup material for use by field assessors during the EVM assessment.

These data are presented as two tables; one sheet of bar charts and seven

Nomogram graphs; how these are used in the field is explained below.

3. Reference data sheets: The tool uses these worksheets for lookup purposes; they also provide the field assessors with essential equipment specification data.

4. Data collection worksheets: There are two of these: Worksheet_A and

Worksheet_B. These can be printed out, copied and taken to the field as a means for collecting specific data in a systematic way. Calculations can either be carried out manually or the data can be brought back from the field and entered into the electronic version of the worksheet.

In addition to the guidance on the summary worksheet the input data sheets include step-by-step notes to guide users through the data entry process.

Worksheets tags are colour-coded by type: The index sheet tag is coloured dark grey ; data entry sheets are coloured pale yellow; information sheets are coloured indigo ; nomograms are coloured dark green and database sheets are coloured dark blue .

Sample screen shots, graphs and charts are shown in the following sections to explain the use of the tool and how its output should be used during an EVM field assessment.

1

There are two further hidden worksheets for translation and country data.

01072010-EVM-assistant-E-V3.doc 13 of 44 01 Sep 2010

4. User instructions

The EVM Assistant tool is designed to help assessors answer the EVM questions listed above in section 2.

The lead assessor must collect the primary and secondary data listed in section 3 before the field assessment exercise begins. These data are entered into the tool to generate a set of country-specific nomograms; these charts are then printed out and photocopied so that each of the field assessment teams has a complete set before they travel. It is not necessary that the assessment teams should take an electronic copy of the EVM Assistant with them, although they may do so if they wish.

Correct use of the nomograms, the equipment data lookup sheets and other standard data collection forms will help ensure that the numerical questions in the EVM tool are answered in a systematic and standardized manner.

4.1 How to start the tool

Open theEVM Assitant tool and save it with the country name – for example:

EVM_Assistant_V1_Tunisia_2010. Click on the Cover tag. Enter the country name, language choice and date. Currently the tool is available in English and French; other language versions will be developed in the future. Note that there are some elements of the tool which are not translated – for example the titles on the nomograms.

Figure 1: Cover worksheet

E V M A S S I S T A N T

Country:

Language:

Date:

Afghanistan

English

10 October 2010

Click to index page v1.0 beta - June 2010

EVM— setting a standard for the vaccine supply chain

Next click on the Index tag; use this worksheet to familiarize yourself with the contents of the workbook and to navigate to the individual worksheets via the hyperlinks provided. Note that there are no hyperlinks to the nomograms. See

Figure 2.

01072010-EVM-assistant-E-V3.doc 14 of 44 01 Sep 2010

Figure 2: Index worksheet.

Index and instructions

Data input sheets:

Vaccine_select Data entry to generate vaccine volumes per Fully Immunized Child (FIC) or per Target Population

Facility_table Data entry to generate results for all facilities in tabular form

Nomo_data Data entry to generate the Nomograms

Estimated weight of safe injection equipment per recipient

Volume_Inject Estimated net storage volume of diluents and injection equipment per recipient

Weight_Inject Estimated weight of safe injection equipment per recipient

Nomogram_Positive_no_polio Nomogram for +5°C vaccine storage at primary and sub-national where OPV is kept at -20°C

Nomogram_Negative_polio Nomogram for -20°C vaccine storage at primary and sub-national levels

Nomogram_Positive_LD_SD Nomogram for +5°C vaccine storage at lowest delivery and service delivery levels where all vaccines are kept together at +5°C

Nomogram_DrySt Nomogram for dry storage capacity for diluents, syringes and safety boxes

Nomogram_Transport Nomogram for transport capacity

Nomogram_Passive Nomogram for passive container capacity (cold boxes, etc) during transport

Nomogram_Waterpacks Nomogram for icepack freezing or cooling capacity

Sheets for manual data entry or automatic calculation:

Worksheet_A Data entry and calculation sheet for shelving store net storage capacity assessment

Worksheet_B Data entry and calculation sheet for maximum and minimum stock level assessment

Sheets with reference data:

Vaccine_database Vaccine database

PQEquipment PIS/PQS prequalified refrigerator and freezer database

Passive_Containers PIS/PQS prequalified cold box and vaccine carrier database

Icepacks Icepack database

Revisions

Revision history Version control

Notes:

1) Introduction: The EVM Assistant helps EVM assessment teams collect and calculate the data required to complete the Criterion E3 storage and transport capacity indicators and some of the Criterion E6 stock management indicators. Refer to the companion EVM Assistant user guide for full details of how to use the tool.

2) How to use the Assistant: Collect the necessary data and complete the Vaccine_select and Analysis worksheets, preferrably before going to the field. Provide each assessment team with hard copies of the FAGs and data collection worksheets you have prepared. Also provide hard copies of the PQEquipment and Passive_Containers worksheets to help the teams with cold chain equipment identification. Then proceed as follows:

STEP 1: Collect country data: Refer to the user guide for detailed information on preliminary data collection. Obtain these data from the national EPI team.

STEP 2: Estimate net storage volume per recipient using the Vaccine_select worksheet.

STEP 3: Generate the Nomograms by completing the Nomo_data worksheet and/or use the Facility_table worksheet to generate a facility summary.

STEP 4: Print, copy and distribute, nomograms, data entry sheets and reference sheets to the teams.

STEP 5: Enter the collected data in the EVM workbooks.

4.2 How to generate the nomograms

The next two sections describe how to generate the nomograms.

4.2.1 Vaccine_select worksheet

Click on the Vaccine_select worksheet. Take the immunization schedule data you have already collected (Tables 3 and 4) and proceed as follows – see Figure 3:

1. Select the vaccine database filter you want to use in cell E4. You can either choose ‘None’, or ‘WHO Intern. Shipping guidelines’. The first choice gives you access to the complete vaccine database. The second choice only offers data on generic vaccines of each type. If vaccines are supplied to the country by

UNICEF, the second choice is preferable because UNICEF does not guarantee that its WHO-pre-qualified vaccines will be supplied by a specific manufacturer.

2. Select the type of recipient group used in cell E7 for estimating vaccine demand by following national policy. There are two options: ‘FIC’ (fully immunized child) which refers to the annual birth cohort, or ‘Target Group’, expressed as a percentage of the total population. Choosing ‘Target Group’ opens up the cells in column M for data entry. IF ‘FIC’ is chosen, this column is blanked out.

3. Use the drop-down lists in the column B data entry cells to enter each of the vaccines in the current schedule. Optionally, you may also enter any additional vaccines that will be present in a new vaccine schedule. You may want to do this if you are investigating the effect on storage capacity of adding or subtracting vaccines from the existing schedule.

4. Use the drop-down lists in column C to specify the vaccine presentations.

5. Optionally, you can use the cells in column D and E to enter packed volume-perdose data for vaccines or diluents using actual national figures

2

. This will override the maximum packed volume data from the database. If left blank, the maximum packed volume for each vaccine will be extracted from the database.

2

This option may be used for locally produced vaccines and for other vaccines which are not included in the EVM Assistant database. Alternatively, you can add the figures to the database and then use the drop-down list.

01072010-EVM-assistant-E-V3.doc 15 of 44 01 Sep 2010

6. Optionally use the cells in column I to enter vaccine wastage rate as per national figures if exist. This will override the WHO/GAVI indicative figures from the data base. If the cells in column I are left blank, the WHO/GAVI indicative figures will be extracted from the database.

7. If the choice in cell M10 is ‘Target Group’, enter data for each vaccine in column

M. The target group for each vaccine is expressed as a percentage of the total population – for example, 10%.

8. In column O, enter the number of doses per FIC or Target Group for each of the vaccines in the current schedule.

9. Optionally, in column P, enter the number of doses per FIC or Target Group for each of the vaccines in the new schedule. Note that you must repeat the column

O figures for any existing vaccines that are retained in this new schedule. Do not enter a figure if one or more of the existing vaccines is being replaced by the new vaccine. For example if DTP-HepB-Hib is replacing DTP and HepB, only enter doses per recipient for the new pentavalent vaccine, not for DTP and

HepB.

10. In column R, enter the MaxStock level established at primary level in months for each vaccine.

The calculated volumes are accumulated in cells O34-37 for current immunization schedule and in cells P34-37 for the new immunization schedule (if any). These figures are used in the Nomo_data worksheet to produce nomograms based on one or more standardized delivery intervals. They are also used in the Facility_table worksheet if the user wishes to use this method of volume assessment.

Figure 3: Vaccine_select worksheet

4.2.2 Nomo_data worksheet

Click on the Nomo_data worksheet to enter the remaining data that are needed to generate the nomograms. You will find instruction how to use this on the worksheet itself. Use the stock management data you have already collected (Tables 5 and 6) and proceed as follows:

01072010-EVM-assistant-E-V3.doc 16 of 44 01 Sep 2010

See Figure 4. In cell F4, select the immunization schedule you want to use (‘Current’ or ‘New ’). This choice applies throughout the worksheet and the nomograms that it generates.

A. Polio kept at -20

°

C and all other vaccines kept at +5°C

See Figure 4.

1. In cell F7, select the store type for which you want to generate nomograms

(‘Primary’ or Sub-national’).

2. In cells F8 and F9, enter the minimum and maximum population figures for the stores where are included in the assessment (Tables 5 and 6 – Minimum population size 1 and Maximum population size 1). This establishes the x-axis range for the nomograms on the two worksheets: Nomogram_Positive_no_Polio and Nomogram_Negative_Polio.

3. If you are assessing primary stores, you should select ‘per individual vaccine’ in cell F11. Primary stores receive vaccine direct from the vaccine manufacturer and the supply interval may vary from vaccine to vaccine. The tool takes account of this. For the sub-national stores, enter up to three additional figures for

MaxiStock

3

. Each choice will generate a line on the relevant nomogram. You may need to enter more than one option for the sub-national stores because some of these stores might receive vaccine at different intervals from other ones.

For example you might have two levels of sub-national store – say regional and provincial. If the regional store receives vaccine from the primary store every three months, enter ‘3’ in one of the cells. If the provincial stores receive vaccine every six weeks from the regional stores, type ‘1.5’ in one of the other cells

4

.

Figure 4: Nomo_data worksheet – Section A

Taking the example above, the two nomograms generated by section A will now show a ‘per individual vaccine’ line which you can use for your primary store(s), a

3-month line for your regional stores and a 1.5-month line for your provincial stores.

3

MaxiStock represents the maximum stock volume which is held in the store you are assessing, including a 25% allowance for safety stock.

4

Fractional months are not shown on the drop-down list, but you can type in a figure. You will receive an advisory warning.

01072010-EVM-assistant-E-V3.doc 17 of 44 01 Sep 2010

B. All vaccines kept at +5°C

See Figure 5. Repeat steps 2-3 for the storage or service delivery where all vaccines are kept at +5 o

C. The ‘per individual vaccine’ option is not offered in the

MaxiStock cells. These data generate the nomogram on worksheet

Nomogram_Positive_LD_SD.

Figure 5: Nomo_data worksheet – Section B

C. Dry storage capacity for diluents, syringes and safety boxes

See Figure 6 and proceed as follows:

1. In cell F25, select the products you want to include in the nomogram calculation. Choose ‘All together’ if the dry store keeps diluents, syringes and safety boxes in the same location. Otherwise choose ‘diluents’ or ‘syringes and 'safety boxes'. Typically diluents are kept separately in the ambient area of the vaccine store. In this situation you should generate one nomogram for the diluents and another one for the syringes and safety boxes.

2. Enter population and MaxiStock data as previously described.

Typically diluents are kept separately in the ambient area of the vaccine store. In this situation you should generate one nomogram for the diluents and another one for the syringes and safety boxes.

Figure 6: Dry storage capacity for diluents, syringes and safety boxes.

D. Transport, passive containers and water-packs

See Figure 7 and proceed as follows:

1. There are two delivery options. Cells D37-D40, cover vaccines and diluents.

Cells F37-F40 cover syringes and safety boxes. In both groups of cells , select up to four options for the number of deliveries per year. If vaccine and diluents are delivered at the same time as the syringes and safety boxes simply enter the same number of deliveries per year in all options.

Otherwise, you can simulate possible scenarios that represent your actual

01072010-EVM-assistant-E-V3.doc 18 of 44 01 Sep 2010

delivery schedule. Each of the combined options you choose will generate a line on the respective nomogram.

2. In cell F42, select the type of passive container used for delivery (cold box or vaccine carrier). Four options are offered: 'CB_ large', 'CB_small', 'VC_large',

'VC_small'.

3. In cell F47, select the type of water-packs use for the delivery. Four options are offered based on nominal capacity in litres: ( 0.3, 0.5, 0.6 or average).

Choose ‘average’ if you expect a mix of icepacks to be used.

4. Enter minimum and maximum population in cells F49 and F50 as previously described.

5. These data generate the passive container requirement, the volume to be delivered, and the water-pack freezing or cooling capacity needed. The following nomograms are generated: Nomogram_Transport; Nomogram

Passive and Nomogram_waterpacks.

Figure 7: Transport, passive containers and water-packs

4.2.3 Facility_table worksheet

The Facility_table worksheet performs the same calculations as the nomo_data worksheet, but presents the results in tabular form. Each line in the table represents a single storage facility, so the entire assessment can be carried out on one worksheet. Up to 100 facilities can be entered.

Figure 8: Facility_table worksheet

01072010-EVM-assistant-E-V3.doc 19 of 44 01 Sep 2010

Calculations take place in the grey cells on the right hand side of the sheet, based on data entered in the white cells. If existing capacity does not meet calculated volumes, the cells are highlighted in pink. Otherwise they are highlighted in blue. This enables the analyst to see at a glance where there are areas of concern.

4.2.4 Reference data worksheets

In addition to the ‘active’ worksheets, there are four further worksheets which contain database information; these data are either used dynamically in the tool or by the user in the field to identify equipment.

A. Vaccine_database sheet:

This sheet provides all necessary information on the vaccines currently available from WHO pre-qualified manufacturers. The table include type; presentation; trade name; mode of administration; packed volume per dose; availability of VVM, source of data, etc. Users can update the database to include vaccines from other manufacturers, including locally produced vaccines that may be used in individual countries.

B. PQEquipment sheet:

This sheet provides up-to-date information on refrigerators and freezers currently available from all WHO pre-qualified manufacturers. The worksheet can be printed out and used as a look-up table by EVM assessors to establish the available net storage capacity of equipment observed in the field.

C. Passive_Containers sheet:

This sheet provides data on WHO pre-qualified cold boxes and vaccine carriers available from all WHO pre-qualified manufacturers. This worksheet is used as a look-up table to establish the net vaccine storage capacity, icepack size and icepack numbers that are needed to complete the transport capacity table in the Nomo_data worksheet. It can also be printed out for field identification purposes.

D. Waterpacks sheet

This sheet provides data on WHO pre-qualified water-packs.

E. Worksheet_A

This worksheet can be printed out and used by field assessors to collect dimensional data for cold rooms, freezer rooms and dry stores where vaccines and other products are stored on shelves. The worksheet contains formulae so it can also be used to calculate results automatically – see Figure 8 in the next section.

F. Worksheet_B

This worksheet can be used to collect data on maximum and minimum stock levels.

As with Worksheet A, it also contains formulae so that data can be entered and results calculated automatically. Alternatively, instructions are provided on the sheet to help with manual calculations.

01072010-EVM-assistant-E-V3.doc 20 of 44 01 Sep 2010

Figure 9: Worksheet B

01072010-EVM-assistant-E-V3.doc 21 of 44 01 Sep 2010

5. Field measurements and manual calculations

This section describes the field measurements and other data you need to collect, and the calculations you need to make, in order to establish available storage capacity.

5.1 Measuring net storage capacity

Several EVM indicators require the assessor to calculate net storage capacity as part of the overall assessment. Table 7 lists the relevant indicators.

Table 7: Criterion E3 – storage capacity indicators

Question no. EVM Question Source

E3:01a A

E3:02a B

Measure the net storage capacity of the +2°C to +

8°C store(s) in litres or m³

Field data &

EVM Assistant

Measure the net storage capacity of the -20°C store(s) in litres or m³

Field data &

EVM Assistant

E3:03a A

E3:05a A

E3:06a B

Measure the net storage capacity of the dry store in litres or m³

Supplementary vaccines- Measure the net storage capacity of the +2°C to + 8°C store(s) in litres or m³

Supplementary vaccines- Measure the net storage capacity of the -20°C store(s) in litres or m³

Supplementary vaccines- Measure the net storage capacity of the dry store in litres or m³

Field data &

EVM Assistant

Field data &

EVM Assistant

Field data &

EVM Assistant

E3:07a A Field data &

EVM Assistant

Net storage capacity is defined as the maximum volume of goods that can be accommodated in a store in the locations specifically allocated for storage. In a shelving store this means the shelf units; in a pallet store it means the designated pallet bays.

No storage location can ever be fully used – there will always be some wasted space because boxes and other containers never fully fill a shelf unit or a pallet bay. After you have calculated the available storage capacity it is necessary to apply a

‘utilization factor’

5

to allow for this.

5.1.1 Calculation method for cold stores and dry stores with shelving

The method described below can be used for any cold room, freezer room or dry store where products are stored on shelves. It can be difficult to establish whether the capacity of a dry store is adequate, because these spaces are often used to store multiple products. If this is the case, you should ask the storekeeper to describe the shelving units that s/he has specifically assigned for diluents or for syringes and safety boxes.

Print out Worksheet A and use it to record the layout of the store and to carry out the net volume calculation. Use one sheet for each room. Make sure you draw a plan and also a section through the shelving units. You can use the formulae at the bottom of the form to calculate the net storage capacity. Alternatively, just record the

5

See WHO/V&B/02.34. A value of 0.67 is used as standard in all EVM shelving store calculations.

Higher or lower figures may be appropriate in specific circumstances. For example, if a limited range of carton sizes is stored – for example syringes – a higher figure may be acceptable because shelving can be optimized for that particular product. On the other hand, a dry storage area containing spare parts may require a lower figure because the range of product shapes and sizes stored is so varied.

01072010-EVM-assistant-E-V3.doc 22 of 44 01 Sep 2010

dimensions and give the sheet to the team leader. S/he can use the electronic version of the worksheet to calculate the results. You will sometimes have to use your judgement when calculating. For example, if there are shelf units running below one of the refrigeration units, the standard ‘shelf unit volume’ formula will not give a correct result. In such cases you will have to do the calculation manually. Similarly if you are measuring a dry store with a 4 metre high ceiling, but with shelf units only 2 metres high, you will get incorrect results because you cannot stack cartons on the top shelf up to ceiling level. In such a situation, the maximum stacking height is probably around 2.5 metres so you can get a correct result by using 2.5 metres as the ceiling height.

Figure 10: Worksheet A example

If the room is very large and complicated you may have to draw the layout on a separate sheet of paper. Keep all your worksheets together and give them to the

01072010-EVM-assistant-E-V3.doc 23 of 44 01 Sep 2010

team leader at the end of the assessment so that your manual calculations can be double-checked.

A blank copy of Worksheet A is shown in Annex 9.

5.1.2 Calculate method for PIS/PQS pre-qualified refrigerators and freezers

Assessors will record details of all the refrigerators and freezers at each facility, including make and model. For PIS/PQS pre-qualified models, the net vaccine storage capacity and/or the icepack freezing capacity can be obtained from the

PQEquipment worksheet. See example in Figure 10.

Figure 11: Equipment lookup table

5.1.3 Calculation for non PIS/PQS pre-qualified refrigerators and freezers

Assessors should also record the make and model of refrigerators and freezers that are not WHO pre-qualified. For these models there are no published data on vaccine storage capacity, so this must be measured on site. Figure 7 illustrates dimensions that should be recorded in a typical front-opening domestic refrigerator and describes the calculation method.

Figure 12 – Guidance diagram for measuring domestic refrigerators

01072010-EVM-assistant-E-V3.doc 24 of 44 01 Sep 2010

5.1.4 Calculation method for cold stores and dry stores using pallets

Many countries use pallets for storing syringes and safety boxes. Some countries are beginning to use pallets for storing and handling vaccines in larger cold rooms.

A typical shrink-wrapped 120 x 80 cm pallet holds around 1,000 litres (1.0 m³) and a

120 x 100 cm pallet can hold around 1,200 litres (1.2 m³). However pallets are often used simply as a convenient way to keep manually stacked products off the floor. In this case cartons may be stacked up to 2.0 metres high, or more; in this situation the volume per pallet has to be calculated. Figure 8 shows an example of this approach.

Volume in litres per pallet = pallet width x pallet depth x stack height/1,000

Volume in m³ per pallet = pallet width x pallet depth x stack height/1,000,000

(dimensions are measured in centimetres).

Figure 13: Pallets used as a base for manually stacked vaccines

A estimate of the approximate capacity of a pallet store can be done in the following way:

1. Floor standing, no stacking: If goods are stored on pallets standing on the floor, first establish how many pallets can be accommodated in the store in such a way that every pallet is accessible. In a well-organized store the pallet positions should be marked on the floor and the bays can then be counted.

Net storage capacity = (number of pallet positions x volume per pallet)

2. Floor standing with stacking: Pallets are often stacked on top of one another, especially where products like syringes are kept in bulk. This arrangement is not very good practice because it restricts EEFO handling. The calculation in this case is similar to the previous example.

Net storage capacity = (number of pallet positions on the floor x number of tiers in a stack x volume per pallet)

3. Pallet racking: Modern pallet stores use pallet racking to store pallets in multiple tiers. Racking is built as a series of bays, each one of which typically fits two standard pallets. Pallet racking stores cannot operate without mechanical lifting equipment. The calculation in this case is as follows.

01072010-EVM-assistant-E-V3.doc 25 of 44 01 Sep 2010

Net storage capacity = (Number of pallet positions x volume per pallet)

01072010-EVM-assistant-E-V3.doc 26 of 44 01 Sep 2010

Figure 14: Pallet racking store

As noted previously, it can be difficult to establish whether the capacity of a dry store is adequate, because these spaces are often used to store multiple products. If this is the case, you should ask the storekeeper to describe the area in the store that s/he has specifically assigned for syringes and safety boxes. If s/he is unable to do this it is likely that the store is not well managed.

5.2 Measuring icepack or cool water pack capacity

The indicator applies only where cold boxes are used for vaccine distribution. In future, once suitable products have been pre-qualified, the indicator will also cover palletised and wheeled insulated containers. Assessors will record details of all the icepack freezers at each facility, including make and model. For PIS/PQS prequalified models, the net vaccine storage capacity and/or the icepack freezing capacity can be obtained from the PQEquipment worksheet. See example in Figure

10, repeated here

Figure 15: Equipment lookup table

The following data are needed to establish whether the equipment is adequate to satisfy needs:

1. Total icepack freezing/cooling capacity in kg/24 hrs.

2. Total icepack storage capacity in litres if used in combination with the freezing capacity.

01072010-EVM-assistant-E-V3.doc 27 of 44 01 Sep 2010

3. Peak demand for icepacks and/or cool water packs in kg/24hrs.

5.3 Measuring the capacity of cold boxes and passive containers

The indicator also only applies where cold boxes are used for vaccine distribution.

The table below shows which indicators are considered here.

Assessors will collect the following information:

1. Make and model of the most commonly used passive containers in the country.

2. Number of each type available at each visited facility.

After collecting this information, use the Passive_Containers worksheet to find the number and size of icepacks needed for each cold box and its vaccine storage capacity. See example in Figure 15.

Figure 16: Cold box lookup table

See Annex 6 for an example of a nomogram generated using these data.

5.4 Measuring transport capacity

A transport capacity calculation is only needed for ‘full’ assessments at primary and sub-national levels. The vaccine distribution data required can be collected at the same time as the data needed for the icepack/cool water pack calculation.

Assessors will measure the gross capacity of the available delivery vehicle(s). For refrigerated vehicles, curtain sided and box bodied vehicles this is the internal length, width and height of the refrigerated body. For flatbed trucks, pickups and the like it is the internal length and width of the load carrying area.

Refrigerated vehicles: Vaccines are likely to be shipped in un-insulated cartons, in plastic crates, or on pallets

6

. Therefore the maximum vaccine capacity of the vehicle is defined by the available safe storage volume which is: usable internal length x usable internal width x useable stacking height

7

x a utilization factor to allow for the space occupied by the packing crates or boxes.

Safe stacking height is determined by the stability of the load AND the need to maintain air circulation; the packing crate utilization factor needs to be established

8

.

Other vehicles: Vaccines will be shipped in cold boxes or the future palletised or wheeled insulated containers. Therefore the maximum vaccine capacity of the

6

Refrigerated vehicles are sometimes used to transport cold boxes, but this is highly inefficient.

7

Typically allowing at least 450mm free space above the load plus the height of a pallet (150mm) below the load to allow for air circulation all round. But this depends upon the vehicle and the location of the refrigeration unit. Ideally, all refrigerated vehicles should be temperature-mapped to establish the limits of the safe storage zone. If mapping has been carried out, the results will establish the useable volume.

8

See for example: Loading a Reefer to Optimize Quality http://www.horizonlines.com/getdoc/0120a540fa17-4762-937d-b1abfe6c66f6/LoadingaReefertooptimizeqty.aspx

01072010-EVM-assistant-E-V3.doc 28 of 44 01 Sep 2010

vehicle is defined by the number of insulated units that can be loaded and safely restrained for the journey. For cold boxes on a flatbed or curtain-sided truck this is likely to be no more than 2 or 3 layers. It could be more for a box bodied vehicle where the body provides additional lateral restraint.

5.5 Compliance with safety stock and maximum stock levels

Table 8 below lists the relevant EVM indicators.

Table 8: Criterion E6 – stock management system

Question No. EVM Question

E6:20a D During the review period, did the stock of each and every vaccine remain within its EVM recommended maximum? [Y,

N]

Source

Field data &

EVM

Assistant

E6:21a E During the review period, did the stock of each and every vaccine remain within its EVM recommended minimum? [Y, N].

Field data &

EVM

Assistant

EVM recommends that all countries set a maximum stock level and a minimum

(safety stock) level for each vaccine and that these levels are observed in all stores.

This is the best way to reduce the risk of stockouts and overstocking. The EVM guidance note and scoring system accepts a discrepancy of +10% on maximum stock level and -10% on minimum stock levels.

In addition to this, the methodology built into Worksheet B allows a maximum stock level breaches that could occur due to demand uncertainty but no stores are expected to continue receiving vaccines while the current stock is above the maximum stock level. The worksheet B further allows stores to remain below the minimum stock level only till next delivery that provides opportunity to make adjustment. No stores are expected to stay below the minimum stock levels through two consecutive deliveries.

Vaccines arrive in stores either through a delivery or a collection system. The number of deliveries per year and the quantities required for each of the chosen vaccines should be planned. However, demand inevitably varies and a well-managed facilities will make appropriate stock adjustments every time supplies are requisitioned. If this is not done, stock levels will be out of balance. Worksheet B can be used to check this. Figure 16 gives an example.

Figure 17: Worksheet B – assessing maximum and minimum stock levels

01072010-EVM-assistant-E-V3.doc 29 of 44 01 Sep 2010

The data collection and scoring principles are as follows:

•

Select a minimum of three of the vaccines shown in the Vaccine type column.

This list is automatically generated from the Vaccine_select worksheet.

•

Ask the storekeeper to give you the ‘maximum stock level’ and ‘minimum (safety stock) level’ for each vaccine. Enter these data in column D. If you cannot obtain this information, you cannot score the indicators.

•

•

Calculate the allowed range: +-10% maximum and minimum and enter in the column E. If you are using the electronic version, these figures are calculated automatically.

Check the record of the selected vaccines and enter the maximum and the minimum records in the worksheet B.

•

For each vaccine, check if stores are continuing receiving vaccines while remaining above the maximum stock levels during deliveries. If this case is valid enter "1" in column R for maximum stock level.

•

For each vaccine, check if stores are continuing remaining below the minimum stock level during delivery or collection. If this case is valid enter "1" in column R for minimum stock level.

•

• two consecutive instances below the minimum stock level -10% and the number of two consecutive instances above the maximum stock level +10%. Enter these figures in column R. In the electronic version the count is done automatically.

Check the record for minimum and maximum stock in column R. If the figure for one of stock breaches is 1, score ‘Y’ against the respective indicators.

Otherwise, score ‘N’.

01072010-EVM-assistant-E-V3.doc 30 of 44 01 Sep 2010

6. How to read and use the nomograms

This section describes how to use the nomograms when working in the field. The example shown in Figure 17 shows vaccine storage capacity at primary and subnational levels at +5°C. At these two upper levels in the supply chain, polio vaccine is kept at frozen. The companion chart Nomogram_Negative_Polio is used to estimate the required storage capacity at -20°C.

In the example chart the target population range shown on the bottom x-axis is set between 50,000 and 2,000,000. This range has been chosen because the primary store serves a maximum of just over 1.8 million recipients and the smallest subnational store serves around 100,000 recipients.

The figures on the vertical y-axis show the net vaccine volume in thousands of litres.

The four sloping lines show maximum stock levels for deliveries ‘per individual vaccine’ and, at 3 month, 6 month and 9 month intervals. The colour coding is shown in the legend at the bottom of the chart. We will be using the ‘per individual vaccine’ line (black) and the 3 month line (blue) in the two scenarios that follow.

Figure 18: Reading a nomogram

Nomogram for positive cold-chain capacity estimates: Polio kept at -20°C and all other vaccines at +5°C

70,000

60,000

50,000

40,000

30,000

20,000

10,000

-

5

0,

00

0

1

01

,3

00

1

52

,6

00

2

03

,9

00

55

,2

2

00

3

06

,5

00

57

,8

3

00

4

09

,1

00

4

60

,4

00

5

11

,7

00

5

63

,0

00

6

14

,3

00

6

65

,6

00

7

16

,9

00

7

68

,2

00

8

19

,5

00

8

70

,8

00

9

22

,1

00

9

73

,4

00

,0

24

1

,7

00

1

,0

76

,0

1

00

,1

27

,3

00

1

,1

78

,6

00

1

,2

29

,9

00

1

,2

81

,2

00

1

,3

32

,5

00

1

,3

83

,8

1

00

,4

35

,1

00

1

,4

86

,4

1

00

,5

37

,7

00

1

,5

89

,0

1

00

,6

40

,3

00

1

,6

91

,6

1

,7

00

42

,9

00

1

,7

94

,2

00

1

,8

45

,5

00

1

,8

96

,8

00

1

,9

48

,1

00

1

,9

99

,4

2

,0

00

50

,7

00

Annual birth cohort per individual vaccine-MaxiStock 3-month_MaxiStock 6-month_MaxiStock 9-month_MaxiStock

The first scenario is at the national vaccine store (NVS) – a primary store. The second scenario is at a provincial store – i.e. at sub-national level.

6.1 Scenario 1 – National vaccine store

Scenario:

•

Population served: 1,830,000

•

Vaccine is delivered to the store direct from the vaccine manufacturers at different intervals. BCG, pentavalent and OPV are received three times a year.

Measles and TT are received twice a year. The maximum stock level established

01072010-EVM-assistant-E-V3.doc 31 of 44 01 Sep 2010

for each vaccine is different. Therefore we need to use the ‘per individual vaccine’ line on the chart (black line).

•

OPV is stored at -20

°

C, so does not contribute to the volumes on this chart

•

The NVS has four large cold rooms. Using Worksheet A you have assessed the available net storage capacity as 30,000 litres.

Assessment:

•

Enter the figure you have calculated for net storage capacity (30,000 litres or 30 m³) against indicator E3:01a – A in the EVM questionnaire.

•

Refer to the black line on the chart. Draw a vertical line from the x-axis where the population = 1,830,000.

•

Draw a horizontal line from the point where the vertical line intersects the black line back to the y-axis. Read off the net vaccine volume ~ 18,000 litres. This is the maximum volume of vaccine you expect in the store.

•

Add 10% to the net vaccine volume to allow some tolerance for periodic overstocking: 18,000 x 1.1 = 19,800 litres, or 19.8³.

•

Enter this figure in the EVM questionnaire against indicator E3:01a – B.

Because the available net cold room capacity is greater than the maximum vaccine volume + 10%, you now know that the country has sufficient storage capacity at the

NVS.

6.2 Scenario 2 – Provincial store

Scenario:

•

Population served: 700,000

•

Vaccine is delivered to the provincial store from the NVS. All six vaccines are delivered at three monthly intervals and all are stored at +5

°

C. The maximum stock level set for all vaccine is 3 months. Therefore we need to use the 3-month line on the nomogram for cold storage capacity where, again, all vaccines except

OPV are kept at +5°C.

•

The regional store has two cold rooms. Using Worksheet A you have assessed the available net storage capacity as 8,500 litres.

Assessment:

•

Enter the figure you have calculated for net storage capacity (8,500 litres or 8.5 m³) against indicator E3:01a – A in the EVM questionnaire.

•

Refer to the blue line on the chart. Draw a vertical line from the x-axis where the population = 700,000.

•

Draw a horizontal line from the point where the vertical line intersects the black line back to the y-axis. Read off the net vaccine volume ~ 8,500 litres. This is the maximum volume of vaccine you expect in the store.

•

Add 10% to the net vaccine volume to allow some tolerance for periodic overstocking: 8,500 x 1.1 = 9,350 litres, or 9.4m³.

•

Enter this figure in the EVM questionnaire against indicator E3:01a – B.

Because the available net cold room capacity is smaller than the calculated maximum vaccine volume + 10%, you now know that this provincial store has insufficient storage capacity. In your recommendations and improvement plan you can advise whether storage capacity could be increased by adding additional shelving, whether an additional cold room is needed, or whether delivery frequency should be decreased to (say) 2 months.

01072010-EVM-assistant-E-V3.doc 32 of 44 01 Sep 2010

6.3 Other nomograms

The principles described above apply to the use of the other nomograms

01072010-EVM-assistant-E-V3.doc 33 of 44 01 Sep 2010

Annex 1: Nomogram example for storage at -20°C

Scenario: target population between 50,000 and 2,000,000 with maximum stock options per individual vaccine, 3, 6 and 9 months.

Nomogram for negative cold-chain capacity estimates: Polio kept at -20°C

18

6

4

2

10

8

16

14

12

-

5

0,

00

0

1

01

,3

00

1

52

,6

00

2

03

,9

00

2

55

,2

00

3

06

,5

00

3

57

,8

00

4

09

,1

00

4

60

,4

00

5

11

,7

00

5

63

,0

00

6

14

,3

00

6

65

,6

00

7

16

,9

00

7

68

,2

00

8

19

,5

00

8

70

,8

00

9

22

,1

00

9

73

,4

00

1

,0

24

,7

00

1

,0

76

,0

00

1

,1

27

,3

00

1

,1

78

,6

00

1

,2

29

,9

00

1

,2

81

,2

00

1

,3

32

,5

00

1

,3

83

,8

00

1

,4

35

,1

00

1

,4

86

,4

00

1

,5

37

,7

00

1

,5

89

,0

00

1

,6

40

,3

00

1

,6

91

,6

00

1

,7

42

,9

00

1

,7

94

,2

00

1

,8

45

,5

00

1

,8

96

,8

1

00

,9

48

,1

00

1

,9

99

,4

00

2

,0

50

,7

00 per individual vaccine-MaxiStock 3-month_MaxiStock 6-month_MaxiStock 9-month_MaxiStock

01072010-EVM-assistant-E-V3.doc 34 of 44 01 Sep 2010

Annex 2: Nomogram example – all vaccines at +5°C

Scenario: Lowest delivery and service delivery level stores with target population between 5,000 and 25,000 and maximum stock options of

1, 1.5, 2, and 3 months.

Nomogram for positive cold-chain capacity estimates: All vaccines kept at +5°C

350

300

250

200

150

100

50

0

5

,0

00

5

,5

00

6

,0

00

6

,5

00

7

,0

00

7

,5

00

8

,0

00

8

,5

00

9

,0

00

9

,5

00

1

0,

00

0

1

0,

50

0

1

1,

00

0

1

1,

50

0

1

2,

00

0

1

2,

50

0

1

3,

00

0

1

3,

50

0

1

4,

00

0

1

4,

50

0

1

5,

00

0

1

5,

50

0

1

6,

00

0

1

6,

50

0

1

7,

00

0

1

7,

50

0

1

8,

00

0

1

8,

50

0

1

9,

00

0

1

9,

50

0

2

0,

00

0

2

0,

50

0

2

1,

00

0

2

1,

50

0

2

2,

00

0

2

2,

50

0

2

3,

00

0

2

3,

50

0

2

4,

00

0

2

4,

50

0

Population size

1-month_MaxiStock 1.5-month_MaxiStock 2-month_MaxiStock 3-month_MaxiStock

01072010-EVM-assistant-E-V3.doc 35 of 44 01 Sep 2010

Annex 3: Nomogram example for dry store

Scenario: Target population between 5,000 and 100,000 with maximum stock options 1, 1.5, 2 and 3 months.

Nomogram for dry storage capacity estimates: Diluents, syringes and safety boxes

14.00

12.00

10.00

8.00

6.00

4.00

2.00

0.00

5

,0

00

7

,5

00

1

0,

00

0

1

2,

50

0

1

5,

00

0

1

7,

50

0

2

0,

00

0

2

2,

50

0

2

5,

00

0

2

7,

50

0

3

0,

00

0

3

2,

50

0

3

5,

00

0

3

7,

50

0

4

0,

00

0

4

2,

50

0

4

5,

00

0

4

7,

50

0

5

0,

00

0

5

2,

50

0

5

5,

00

0

5

7,

50

0

6

0,

00

0

6

2,

50

0

6

5,

00

0

6

7,

50

0

7

0,

00

0

7

2,

50

0

7

5,

00

0

7

7,

50

0

8

0,

00

0

8

2,

50

0

8

5,

00

0

8

7,

50

0

9

0,

00

0

9

2,

50

0

9

5,

00

0

9

7,

50

0

1

00

,0

00

1

02

,5

00

Population size

1-month_MaxiStock 1.5-month_MaxiStock 2-month_MaxiStock 3-month_MaxiStock

01072010-EVM-assistant-E-V3.doc 36 of 44 01 Sep 2010

Annex 4: Nomogram example for transport capacity

Scenario: Target population between 5,000 and 100,000 with the option of 1, 2 and 3 deliveries per year. The horizontal orange line represents the fourth option, for which a delivery frequency was not entered.

Nomogram for transport capacity estimates

140.0

120.0

100.0

80.0

60.0

40.0

20.0

0.0

5

,0

00

7

,5

00

1

0,

00

0

1

2,

50

0

1

5,

00

0

1

7,

50

0

2

0,

00

0

2

2,

50

0

2

5,

00

0

2

7,

50

0

3

0,

00

0

3

2,

50

0

3

5,

00

0

3

7,

50

0

4

0,

00

0

4

2,

50

0

4

5,

00

0

4

7,

50

0

5

0,

00

0

5

2,

50

0

5

5,

00

0

5

7,

50

0

6

0,

00

0

6

2,

50

0

6

5,

00

0

6

7,

50

0

7

0,

00

0

7

2,

50

0

7

5,

00

0

7

7,

50

0

8

0,

00

0

8

2,

50

0

8

5,

00

0

8

7,

50

0

9

0,

00

0

9

2,

50

0

9

5,

00

0

9

7,

50

0

1

00

,0

00

1

02

,5

00

Population size

1-Vac & 1-Syr-deliveries per year

3-Vac & 3-Syr-deliveries per year

2-Vac & 2-Syr-deliveries per year

-Vac & -Syr-deliveries per year

01072010-EVM-assistant-E-V3.doc 37 of 44 01 Sep 2010

Annex 5: Nomogram example for passive containers

Scenario: Target population between 5,000 and 100,000 with the option of 1, 2 and 3 deliveries per year.

Nomogram for passive container capacity estimates

6000

3000

2000

1000

5000

4000

0

5

,0

00

7

,5

00

1

0,

00

0

1

2,

50

0

1

5,

00

0

1

7,

50

0

2

0,

00

0

2

2,

50

0

2

5,

00

0

2

7,

50

0

3

0,

00

0

3

2,

50

0

3

5,

00

0

3

7,

50

0

4

0,

00

0

4

2,

50

0

4

5,

00

0

4

7,

50

0

5

0,

00

0

5

2,

50

0

5

5,

00

0

5

7,

50

0

6

0,

00

0

6

2,

50

0

6

5,

00

0

6

7,

50

0

7

0,

00

0

7

2,

50

0

7

5,

00

0

7

7,

50

0

8

0,

00

0

8

2,

50

0

8

5,

00

0

8

7,

50

0

9

0,

00

0

9

2,

50

0

9

5,

00

0

9

7,

50

0

1

00

,0

00

1

02

,5

00

Population size

1-deliveries per year 2-deliveries per year 3-deliveries per year 4-deliveries per year

01072010-EVM-assistant-E-V3.doc 38 of 44 01 Sep 2010

Annex 6: Nomogram example for water-pack freezing capacity

Scenario: Target population between 5,000 and 100,000 with the option of 4, 6, 9 and 12 deliveries per year

Nomogram for water-pack freezing or cooling capacity estimation

2000.0

1800.0

1600.0

1400.0

1200.0

1000.0

800.0

600.0

400.0

200.0

0.0

5

,0

00

7

,5

00

1

0,

00

0

1

2,

50

0

1

5,

00

0

1

7,

50

0

2

0,

00

0

2

2,

50

0

2

5,

00

0

2

7,

50

0

3

0,

00

0

3

2,

50

0

3

5,

00

0

3

7,

50

0

4

0,

00

0

4

2,

50

0

4

5,

00

0

4

7,

50

0

5

0,

00

0

5

2,

50

0

5

5,

00

0

5

7,

50

0

6

0,

00

0

6

2,

50

0

6

5,

00

0

6

7,

50

0

7

0,

00

0

7

2,

50

0

7

5,

00

0

7

7,

50

0

8

0,

00

0

8

2,

50

0

8

5,

00

0

8

7,

50

0

9

0,

00

0

9

2,

50

0

9

5,

00

0

9

7,

50

0

1

00

,0

00

1

02

,5

00

Population size

4-deliveries per year 6-deliveries per year 9-deliveries per year 12-deliveries per year

01072010-EVM-assistant-E-V3.doc 39 of 44 01 Sep 2010

Annex 7: Passive container lookup table

Passive container database

WHO/UNICEF Product Information Sheets, WHO/V&B/00.12

Not translated. No user action required

Type

Equipment identification

Make Model

Click to filter:

Large vaccine cold box Electrolux

Large vaccine cold box Ina ColdMed small vaccine cold box Ina ColdMed

Large vaccine carrier Thermos

RCW 25/CF

CB/INO/B3/90

CB/INO/C2/90

3504 UN/CF

Large vaccine carrier Polyfoam Packers EPI/PF/1.5

small vaccine cold box Ina ColdMed small vaccine cold box Oyster International

CB/INO/D1/90

Large vaccine carrier Beijing

Large vaccine cold box Savopak Oy

IA

KR 48

Large vaccine carrier Gio Style Spa

Small vaccine carrier Electrolux

Small vaccine carrier True Pack small vaccine cold box Blow Kings small vaccine cold box Electrolux

Small vaccine carrier Inalsa

Small vaccine carrier Blow Kings small vaccine cold box Electrolux

Large vaccine cold box Apex Continental small vaccine cold box Apex Continental

RCW 2/CF

T.P.001

55-CF

RCW 12/CF

IVC-3

Large vaccine carrier Apex Continental IVC-9AF

Small vaccine carrier Apex Continental IVC-8F

VDC-24-CF

RCW 6/CF

ICB-11F

ICB-8F

Code PIS Code PIS

E4/05-M CB_large

E4/09 CB_large

E4/10 CB_small

E4/18-M VC_large

E4/19

E4/20

E4/22

E4/34

VC_large

CB_small

CB_small

VC_large

E4/37-M CB_large

E4/52-M VC_large

E4/53-M VC_small

E4/55-M VC_small

E4/57-M CB_small

E4/62-M CB_small

E4/67 VC_small

E4/67-M VC_large

E4/68-M VC_small

E4/69-M VC_small

E4/70-M CB_small

E4/72-M CB_large

E4/75-M CB_small

Large vaccine cold box Blow Kings

Large vaccine carrier Blow Kings small vaccine cold box Blow Kings

Small vaccine carrier Promociones LISA

CB/20/5U-CF

VC/42/MOD/2/CF

CB/5/2A/CF

E4/76-M CB_large

E4/77-M VC_large

E4/78-M CB_small

E4/79 VC_small

Large vaccine carrier Nylex Packaging CFC free

Large vaccine carrier Blow Kings BK-VC 1.6 - CF

Vaccine carrier for NID CIP Industries small vaccine cold box Electrolux RCW 8/CF

E4/81-M

E4/83-M

Frigivac for kick PolioE4/84-M

E4/86-M

VC_large

VC_large

CB_small

Large vaccine cold box Apex Continental ICB-14F

Large vaccine cold box Beijing LCB-8A

Large vaccine carrier Blow Kings CB/10 - CF small vaccine cold box Polyfoam Packers 390

Small vaccine carrier AOV International AVC-24

Small vaccine carrier AOV International ADVC-24

Large vaccine carrier AOV International AVC-44

Large vaccine cold box AOV International ACB-503L

Large vaccine cold box AOV International ACB-316L

Large vaccine carrier Termo-Kont TM8

Large vaccine cold box Termo-Kont

Large vaccine cold box Termo-Kont

TM35

TM52

Large vaccine cold box CIP Industries small vaccine cold box CIP Industries

LSR 50

SLR 100

Large vaccine carrier Dometic RCW4

Large vaccine cold box AOV International ACB-246LS small vaccine cold box AOV International ACB-264SL

E4/86-M

E4/87-M

E4/88-M

E4/80-M

E4/89-M

E4/90-M

E4/91-M

E4/92-M

E4/93-M

E4/94-M

E4/95-M

E4/96-M

E4/97-M

E4/98-M

E4/99-M

E4/100-M

E4/101-M

CB_large

CB_large

VC_large

CB_small

VC_small

VC_small

VC_large

CB_large

CB_large

VC_large

CB_large

CB_large

CB_large

CB_small

VC_large

CB_large

CB_small

Vaccine storage capacity (l)

Weight (kg) loaded empty

1.4

1.7

1.7

5.3

20

1.5

7.2

0.7

8.5

1.6

1.6

0.85

0.9

4.4

23.1

5

20.7

16.2

6.5

1.7

1.4

4

9.75

1.3

20.9

2.6

0.6

0.76

8.6

22

3

18.8

28.4

21.6

9

3

16

6

15

1.6

10

9.2

0.86

0.9

1.6

23.3

Water-packs required Cold life Warm life

Type Number @+43°C @-20°C

21.90

1.60

4.32

5.90

10.30

11.20

3.30

14.80

14.20

11.20

2.40

17.50

6.88

1.00

1.40

2.20

22.20

17.00

16.30

12.50

2.50

2.40

7.20

17.60

2.50

28.00

1.80

1.20

0.54

8.20

11.70

1.90

0.6

0.3

1.90

0,3& 0,4&0,6

1.30

0.3

1.10

10.75

0,3 & 0,4

0.3

18.90 0,3& 0,4&0,6

11.80

0.3

20.70

1.80

0,3 & 0,4

0.3

14.80

0,3 & 0,4

1.44 Losani 0,125 l

2.40

1.80

0.42

7.02

0.6

0,3 & 0,4

0.3

0.6

0.3

0.4

0.4

0.4

0.6

0.4

0.4

0.3

0.6

0.4

0.3

0.3

0,3 & 0,4

0,4 & 0,6

0.4

0.6

0.4

0.40

0.40

0.4

0.3

0.6

0.6 & 0.3

0.6

0.4

49.00

3.70

26.80

2.88

5.30

4.50

2.34

13.80

21.00

3.80

4.30

2.20

2.20

19.05

48.90

25.00

32.80

31.80

20.60

5.10

4.50

13.50

32.90

4.50

50.00

6.50

2.10

1.91

21.70

49.50

6.10

16.60

20.50

37.30

24.00

7.60

36.00

26.60

33.30

4.80

33.80

21.10

2.00

2.40

4.20

47.50

Index

20.0

30.0

10.9

4

4

3

10

52

4

26

8

2

19

50

26

14

4

4

2

4

6

24

4

24

12

8

4

24

8

2

3

24

43

22

7

24

26

31

6

22

24

2

2

4

50

22

6

17

27

145.0

36.0

98.0

27.0

53.0

36.0

5.5

49.5

114.0

37.0

36.0

18.5

15.6

65.0

100.0

98.0

129.9

107.0

81.0

34.0

37.0

83.0

119.0

34.0

121.0

32.0

32.0

21.0

65.0

174.0

36.0

63.2

76.0

100.0

112.0

25.7

83.0

134.0

61.0

50.0

95.0

52.0

14.00

19.50

40.50

141.00

01072010-EVM-assistant-E-V3.doc 40 of 44 01 Sep 2010

Annex 8: PIS/PQS refrigerator and freezer lookup table

Refrigerator and freezer database

1) Worksheet is set up for printing in A4 landscape.

2) Some columns are hidden for printing purposes. Hidden columns are only labelled in English.

3) Data are taken from WHO/UNICEF Product Information Sheets, WHO/V&B/00.13, and from the PQS database.

Nbr. of products listed: 48

Index

Refrigerator & freezer

Refrigerator & freezer

Refrigerator & freezer

Refrigerator & freezer

Refrigerator & freezer

Refrigerator & freezer

Refrigerator & freezer

Icepack freezer

Vaccine/icepack freezer

Vaccine/icepack freezer

Vaccine/icepack freezer

Vaccine/icepack freezer

Vaccine/icepack freezer

Refrigerator & freezer

Refrigerator & freezer

Refrigerator & freezer

Refrigerator & freezer

Refrigerator & freezer

Refrigerator & freezer

Icelined refrigerator

Refrigerator & freezer

Refrigerator & freezer

Refrigerator & freezer

Icelined refrigerator & vac/icepack freezer

Description

Click to filter:

Refrigerator

Refrigerator

Icelined refrigerator

Refrigerator & freezer

Refrigerator & freezer

Refrigerator & freezer

Icelined refrigerator

Icelined refrigerator

Icelined refrigerator

Refrigerator & freezer

Refrigerator & freezer

Icepack freezer

Icepack freezer

Icelined refrigerator

Refrigerator & freezer

Refrigerator & freezer

Icepack freezer

Icelined refrigerator

Icelined refrigerator

Refrigerator & freezer

Refrigerator & freezer

Refrigerator & freezer

Refrigerator & freezer

Refrigerator

Equipment identification

PIS/PQS code Type Refrigerant

Temp zone

H=Hot,

T=Temperate

M=Moderate Make Model

Electrolux

Electrolux

Electrolux

Electrolux

RCW 42 EG/CF

RCW 42 EK/CF

TCW 1152/CF

RCW 42AC/CF

E3/21-M

E3/22-M

AR

AR

E3/24-M ILR

E3/30-M CR

Electrolux

BP Solar

Norcoast

Fortum AES

Electrolux

Sun Frost

Dulas

Electrolux

Vestfrost

Vestfrost

TATA BP Solar

Electrolux

Zero

Zero

Electrolux

Norcoast

Electrolux

Electrolux

Zero

Vestfrost

Electrolux

Electrolux

Solamatic

Kyocera Solar

Kyocera Solar

Bright Light Solar

RCW 42DC/CF

VR50F

E3/31-M

E3/37-M

SE

SE

E3/57-M ILR Vestfrost

Electrolux

Electrolux

Vestfrost

Sibir

Sibir

Sibir

Sibir

Vestfrost

Vestfrost

Zero

Dulas

Dometic

Zero

Bright Light Solar

PT. Dilihan Glory

MK 144

TCW 1990

LEC RefrigerationPLC VC 139 F

E3/62-M ILR

E3/64-M ILR

E3/65-M SE NRC 30-10

CFS49 ISI

FCW 20 EG/CF

E3/70-M

E3/72-M

SE

AF

FCW 20 EK/CF

MK 074

E3/73-M AF

E3/75-M ILR

E3/77-M SE RFVB-134a

VC-150 F

TFW 800

E3/79-M

E3/80-M

SE

CF

MK 204

MK 304

TBP VR 50

E3/81-M ILR

E3/82-M ILR

E3/83 SE

V 170 GE

V 170 EK

E3/84-M

E3/85-M

E3/86-M

AR

AR

AR V 110 GE

V 110 KE

RCW 50 EG/CF

PR 245 K/E

GR 245 G/E

E3/87-M

E3/88-M

E3/89-M

E3/90-M

E3/91-M

AR

AR

AR

AR

AR RCW 50 EK

Model 120-30

RCW 50DC/CF

E3/92-M

E3/93-M

SE

SE

RCW 50 AC

PF 230 IP KE

MF 114

E3/94-M

E3/95-M

E3/96-M

CR

AF

CF

MF 214

MF 314

E3/97-M

E3/98-M

E3/99-M

CF

CF

CF FCW 300

FCW 200

PVR150

E3/100-M CF

E3/101-M SE

GR 265 G/E

VC-65 F

E3/102-M AR

E3/103-M SE

VaccPack XL 2100 E3/104-M SE

VaccPack XL 6000 E3/105-M SE

PS65 E3/106-M SE

TCW 3000

PR 265 K/E

PS40

DOVLINE

E3/107-M ILR

E3/108-M

E3/109-M SE

E3/110-M

AR

RC

NH3

R134a

R134a

R134a

R134a

R134a

NH3

R134a

R134a

NH3

NH3

NH3

R134a

R134a

R134a

NH3

R134a

R134a

R134a

R134a

R134a

R134a

NH3

R134a

R134a

R134a

R134a

R134a

R134a

R134a

NH3

NH3

NH3

NH3

NH3

NH3

NH3

R134a

R134a

R134a

R134a

R134a

R134a

R134a

R134a

R134a

NH3

H

H

H

H

H

H

H

H

T

H

H

H

H

H

H

H

H

T

T

H

H

H

H

H

H

H

H

H

T

H

T

H

H

H

H

H

H

H

H

H

H

H

T

T

T

H

H

Dometic TCW 2000 E3/111-M ILR R134a H

Net storage volume (litres) Icepack freezing

Refrigerator Freezer

Kg/24 hrs at 32°C with vaccines

10.5

18.2

169.0

12.0

14.0

17.5

45.0

37.5

107.5

15.5

20.0

20.0

38.7

85.0

63.0

108.0

18.0

55.0

55.0

17.0

17.0

24.0

18.0

18.0

24.0

63.0

24.0

24.0

30.0

16.0

37.5

21.0

60.0

37.5

126.5

37.5

18.0

16.0

60.0

1.6

1.2

12.0

14.0

5.0

12.2

4.8

14.0

14.0

32.5

14.4

145.0

5.0

36.0

36.0

15.0

15.0

20.0

20.0

30.0

4.8

8.0

144.0

72.0

192.0

264.0

264.0

144.0

7.2

9.6

9.6

9.6

9.6

9.6

2.4

42.0

1.1

1.0

2.1

2.1

2.4

2.4

16.5

2.8

3.6

2.4

2.4

3.0

2.3

8.7

18.6

28.8

1.8

3.0

5.4

2.6

6.4

5.4

4.0

5.4

17.5

22.9

32.4

7.2

7.2

3.6

2.4

2.4

16.0

3.1

3.3

2.4

4.3

5.8

6.4

1.2

1.0

1.0

0.6

2.4

01072010-EVM-assistant-E-V3.doc 41 of 44 01 Sep 2010

Annex 9: Worksheet A

A.

Draw a sketch plan of the room showing shelving layout, position of refrigeration units (if any) and position of door(s). Record internal length, width and height of room in centimetres.

Location:

B.

Record the following dimensions in centimetres:

Internal room dimensions

Room length (L) cm

Room width (W) cm

Room description:

Gross volume (L x W x H) m³

Room/stacking height (H)

Shelf unit dimensions cm (in very high rooms enter maximum stacking height)

Unit 1 Unit 2 Unit 3 Unit 4 Unit 5 Unit 6 Unit 7 Unit 8 Unit 9 Unit 10

Shelf width (w)

Shelf length (l)

Nbr of shelves (n)

Shelf thickness (t)

Floor to bottom shelf (b)

Shelf unit volume (litres)

Net storage capacity litres m³

Grossing factor

Formulae for manual calculation:

1) Shelf unit volume =(w x l x (H-(b + 10 + n x t))/1000) x 0.67 litres

2) Net storage capacity = ?(shelf unit volumes)

3) Grossing factor = Gross volume/(Net storage capacity/1000) litres

01072010-EVM-assistant-E-V3.doc 42 of 44 01 Sep 2010

Annex 10: Worksheet B

01072010-EVM-assistant-E-V3.doc 43 of 44 01 Sep 2010

Revision history

Date Change summary

12.05.2010 First draft

18.06.2010 General revision for EVM

Assistant V1

22.06.2010 Acknowledgements section added. Minor change to section 5.5.

24.06.2010 Change on page 28-29 on maximum and minimum stock level evaluation

Reason for change By /Approved

Hailu M. Kenea

Andrew. G and

Souleymane Kone

Hailu M. Kenea

Hailu M. Kenea

01072010-EVM-assistant-E-V3.doc 44 of 44 01 Sep 2010