Analyses of existing mobile data collection against the requirement of organization working in the humanitarian context

Transcription

1 Mbile Data Cllectin in Humanitarian Cntext (NOMAD) Analyses f existing mbile data cllectin against the requirement f rganizatin wrking in the humanitarian cntext Cmpiled by CartONG Cnsrtium NOMAD: IMMAP CartONG WFP (Wrld Fd Prgramme) MEDES Auvea ACAPS

2 I n t r d u c t i n Humanitarian peratins ften take place in areas with pr infrmatin, and when infrmatin is available, it is ften utdated r becmes bslete due t the crisis. The ntin f gegraphical lcatin is fundamental in nearly all sectrs f infrmatin regarding humanitarian peratins. Satellite, mbile phnes and GPS-enabled PDA s have recently becme mre than just cmmunicatin devices and have been pilted successfully in humanitarian peratins, thugh very few rganizatins have standard prcedures in place fr all their data needs. The NOMAD prject (Humanitarian peratins mbile acquisitin f data) was created thrugh a partnership between the fllwing rganisatins: IMMAP, WFP, MEDES, AUVEA and CartONG. It is financed by Centre Natinal d'etudes Spatiales (CNES). Its main bjective is t develp a service enabling humanitarian rganisatins nt nly t cllect ge-referenced data with GPS-PDA devices, but als t submit and synchrnise the data immediately even frm the mst remte lcatins thanks t satellite cmmunicatin. A n a l y s e s f t h e S e c t r n e e d s This research is cmprised f a survey that started n 08/11/2010, cmbined with interviews and web research that were cnducted in Octber 2010 t December Survey distributin: Invitatin sent ut t 555 individuals frm the CartONG Newsletter subscriber s list Crisis Mappers mailing list Included in SIG-la-lettre newsletter Psted n the prject webpages GeRez, ALNAP and the GgleGrup f MbileActive. (GgleGrup, SIG-la-lettre and ALNAP were psted late - last week f Nvember - and therefre have nt cntributed much t the number f respnses.) With a cnservative estimate f 500 invited recipients, the survey respnse rate is at 8.4%, as 42 rganizatins answered the questinnaire. In the prcess f designing and refining this cmplete mbile data cllectin system, the aim was t invlve all stakehlders in the humanitarian cntext and cnsidered the fllwing aspects; What is the current type r system f data cllectin (paper based, desktp r mbile) Limitatin f the currently used system What type f data is t be cllected

3 Hw this infrmatin is translated int an electrnic frmat Where the data is cllected and hw the system cmplement the wrk flw f data capturer Hw the data cllectin is managed Hw the data is transferred r synchrnized Hw the data is verified/updated and analyzed K e y F i n d i n g s f r m t h e s u r v e y a n d s e c n d a r y r e s e a r c h It was clearly nted that all rganizatins cllect and analyse different types f infrmatin. The survey in all cases represents well-defined bjectives t cver the interests f the rganizatin. This makes the use f a cmmn data cllectin applicatin by mre than ne entity difficult. The fllwing graph shws the main area in which the respnding rganisatin is active. Of thse wh answered Emergency relief as first pririty, 40% selected Prtracted crisis as secnd. Of thse wh primarily wrk in a Develpment cntext, 44% als state Emergency relief as their secnd area f wrk. 8% Respndents: Main line f wrk 34% 58% Develpment Emergency relief Prtracted crisis Abut 53% f the respndents are currently cllecting data using paper frm, mainly because it is assumed t be cheaper and requires less training fr cllectrs. One rganisatin als pinted ut that it is safer t use paper and technlgical limitatins in remte areas as well as faster deplyment with standardized paper frms were cited by tw thers. On the ther hand, 78 % f the respndents using paper require the data t be recrded in the system within tw days, which can be a challenging undertaking fr data entry staff.

4 The chart belw shws hw frequently infrmatin is cllected by sectr: WASH 31%; Displacement 28%; Health 25%; Infrastructure 16%. Based n web research [1]; Health, Educatin and Emergency Respnse were the fields where mbile data technlgy with PDA s was predminantly applied. The Health sectr als played a majr rle in mbile data cllectin prjects currently being carried ut with 33%, fllwed by Electin mnitring (15%) and Agriculture (14%). [5]. Sampling Respndents indicated the survey shuld be able t equally gather infrmatin related t an individual a husehld infrastructure a cmmunity (either by a gegraphical area r a grup f peple having smething in cmmn i.e. a grup f peple using the same health centre) (Husehld level and infrastructure mentined slightly mre frequently than the rest) Creatin f questinnaires Frm the census we realize that mre than 80% f the surveys include between 1 and 50 questins. The majrity f rganizatins use surveys cmprising between 10 and 20 questins 36% use 20 t 50 questins. Sme detailed health related r crss-sectral assessments cnduct surveys with mre than 100 questins, fr instance after a disaster.

5 The average number f quantitative questins was cnfirmed t be just ver 40. Bth ne-time surveys and reccurring assessments are equally imprtant and used by respnding rganizatins. Translating surveys int electrnic frms The majrity f respndents are using paper frms fr data cllectin, thugh the data f mre than 70% f the paper frm surveys is then entered in electrnic frmat. 69% f the respndents recrd int a lcal database (Excel r Access) 18% insert it int an nline database. One rganisatin entered directly nline, thers use whatever methd suits best in the current cntext. 28% have already embarked n sme frm f mbile data cllectin, ut f which 44% are interested in cllecting data using mbile technlgy mainly t d GPS tracking and t save time and resurces when analyzing the data. 9% f the rganizatins have neither started nr are interested in using mbile phne data cllectin with ne rganisatin ffering resurce limitatins and prblematic cnnectins as reasns. Cst In cnsequence, almst half perceive the cst t be an issue fr prcurement f mbile technlgy. A few als mentined that it is very difficult t justify prcurement f such a tl fr a ne time survey r that the budget allcated fr surveys in general are very lw in cmparisn with ther prjects. Renting des nt seem t be the best ptin, because it is assumed that the transprt cst, delay, rent and ther csts wuld nt be justifiable in time. Only 13% wuld be interested in this. Renting can be ptentially interesting fr thse cnducting a ne-time survey. Fr thse wh regularly cnduct surveys, 10,000 Eurs is cnsidered t be the maximum amunt they will be ready t invest. Technlgy Amng thse currently using mbile data cllectin, GPS enabled PDA are the mst ppular HP brand was the mst cited. Windws Mbile was the perating system utilized by the majrity, with Andrid technlgy being relatively new. Hwever, 14% f related researched web cntents and 11% f the current prjects are using Andrid technlgy [5].

6 Mst f the rganizatins d nt seem t have the adequate resurces fr the translatin f paper frms int electrnic, as prfessinal assistance was required. Almst 70% ut f the rganisatins which have embarked n using mbile data cllectin have had supprt with the translatin f the electrnic frm, als reflected in the secndary surce [1]. Only ne rganisatin respnded that the survey was newly created fr the mbile data cllectin; all thers had nt changed the structure f the survey. Hwever, in the secndary surces [6, 1] it was mentined that with the use f mbile data cllectin technlgies, the surveys became mre rigrus, abandning many free text level fields. This was seen as a psitive step twards streamlining the data cllectin. Training surveyrs One reasn paper frm surveys are still used is because it is assumed that training is easier with paper than using additinal new technlgy. An average f 65 staff received 12 hurs f training and 16% f the respndents als mentined that they have made prvisins fr future training. Training fr data cllectrs is usually prvided in-huse, thugh almst 10% f the respndents say that they hire smene external t cnduct trainings. Training sessins are predminantly held fr lcal staff, fllwed by internatinal staff; this mirrrs the situatin f the data cllectrs. Training plays a crucial rle in the data cllectin prcess, nt nly relating t the questinnaire but als t clear instructins n hw t use technlgy and cnduct interviews, fcus grups and ther data cllectin activities sme rganizatins have als prvided mre training n thematic grups and identificatin f surces [1]. The same surce als reprts that when using external staff (frm an implementing partner r ther rganizatin), additinal training is als prvided n the rle and

7 mandate f the rganizatin and is mainly dne internally. It is estimated that additinal training needs t cver the technlgy is arund day [6]. One particular respndent, having already the technlgy implemented, realized that the system is nt used t its ptential and wuld nw like t enhance their staff s capacity rather than invest in new systems. Thse nt prviding training use shrter, selfexplanatry questinnaires. By ensuring that all definitins and pssible respnses are incrprated in the questinnaire these rganizatins limit pssible mistakes and misunderstandings. Nne f the surveyed and interviewed rganizatins engage prfessinal surveyrs rather than use available lcal resurces. T ensure the quality f the survey when there are nt sufficient resurces fr lcal staff training n new technlgies, rganizatins pt fr paper frms. Cnducting the survey Mst f the rganizatins that participated in this survey d understand the imprtance f capturing GPS data fr mapping and tracking purpses. Cntrarily, ther multimedia data d nt seem be cnsidered as imprtant, althugh few d require this feature fr visual interpretatin and t use the data as a reference in the future. Accrding t a secndary surce [1], ut f thse rganizatins wh answered the questin cncerning the lcatin f the mbile technlgy, half respnded that their equipment is lcated in the field while the ther half cnfirmed that their equipment is either at the HQ r reginal level. Out f the very few answers received n the difficulty f shipping the equipment t field, 75% claimed that shipping is nt difficult. [In the curse f the NOMAD pilt as well as ther prjects CartONG had been invlved in, the shipping and the clearing f equipment at custms has prven t be difficult in sme cuntries.] Synchrnizing data While there is a range f tls fr data synchrnizatin and slutins such as satellites, GSM, and GPRS amng thers, mre than half f the rganizatins described cmmunicatin as being pr in the field. They d nt find it necessary t synchrnize data at field level. It is unclear whether this is due t the lack f the available technlgy r that the technlgy is nt put in place because synchrnizatin is nt cnsidered imprtant. Accrding t a secndary surce, even when the necessary technical tls are in use at the field level, the synchrnizatin is nt dne during the field wrk but rather in the end f the day / week / mnth. This seems t indicate that immediate synchrnizatin is nt a pririty that wuld justify

8 cnstant use f cstly technlgy. Limiting the synchrnizatin t certain mments is nt cnsidered t have a negative impact n the use f data but can save already limited resurces. The sectrs which mre ften seem t have regular survey schedules fllwing a pre-set frequency are Health and Agriculture. There are slightly mre surveys which are cnducted n a weekly basis than a mnthly basis [5]. One f the rganizatins interviewed n the phne declared that since switching t using mbile phnes r PDA s their data transfer time has cnsiderably shrtened. Tw rganizatins have already used satellite technlgy fr transmitting data, and ne is cntemplating using it, shuld it becme mre ecnmical and reliable. Verifying and analysing data Abut 30 % f the rganizatins use an assessment tl fr data verificatin. This is being dne by triangulatin, cmparisn f data frm several surces, randm quality checks and by reviewing imprbable data. Only 13% f the rganisatins have a system in place t prtect sensitive data. Of thse, ne rganizatin claims that they d nt have sensitive data while ne ther reprts n technical limitatins. Methds used t prtect sensitive data include: encryptin strengthen their data management plicy restrict access simply separate the sensitive data t anther database With the exceptin f ne rganizatin, all stre their data in a lcal machine rather than n-line, mainly using Access. When crssing this infrmatin with the previusly treated issue f training, it can be cncluded that Access is the easiest tl t manage and analyse data. There are tw rganisatins citing Oracle and ne PstGreSQL as their database f chice. The vast majrity f the respndents are nt using an autmatic reprting tl but wuld be interested in a system that wuld enable autmatic reprting. Basic charts and crss-tabulatins were specifically mentined as being f interest.

9 C n c l u s i n The csts related t different stages f a survey seem t limit rganizatins pssibilities t use new technlgies, which require additinal training and increased cmmunicatin csts. Hwever, studies have shwn that the peratinal csts f mbile data cllectin are lwer than its paper based cunterpart, especially if the csts f the devices can be set against several assessments [1,6,7]. Fr human cst alne, it is estimated that the csts are mre than halved by cutting dwn data entry, especially if it is a rigrus survey requiring duble entry t reduce data entry errrs [6,7]. Depending n the type f survey, in particular if the free text fields have been reduced, using mbile devices is faster than paper surveys. [7]. Based n the fact that lcal staff in the field is mainly used fr infrmatin cllectin and reprting and their training is dne internally, implementatin f new technlgies wuld require enhanced training, including training f trainers and fcal pints. Additinal training fr cvering hw t use the mbile phne/pda devices has been estimated t take day per survey. Hwever, the cst savings in terms f data entry and imprved data quality are enrmus and amrtize this investment quickly [1,7]. Fr NOMAD, the type f additinal training required needs t be defined further, frm using the handhelds t synchrnising the data. Many rganisatins assume that the investment bth in technical and human resurces wuld be difficult t justify and finance. The benefits resulting frm the use f mbile data cllectin, such as immediate data cllectin and entry leading t saving time and human resurces, the pssibility f including GPS lcatins, and immediate analyses, have nt yet ut weighted the perceived difficulties related t the initial investment. As can be seen frm case studies, especially fr rganisatins cnducting many assessments n different levels, the benefits and cst savings are vast since the devices culd be reused. A marketing and utreach strategy wuld need t take this int accunt, gathering and citing mre examples f hw an investment in the new technlgies wuld pay ff financially. Mst f the rganizatins wuld see the benefit f mbile data cllectin but d nt have the capacity t fully implement all the invlved aspects, including cmmunicatin and synchrnizatin, which will therefre require the service t include ptins fr all training and supprt aspects fr thse rganisatins which might nt have the necessary resurces in-huse t set up the system. Autmatic reprting has been mentined as a nice add-n t have. A service including basic reprting tls culd therefre be f interest and will certainly assist the marketing.

10 R e f e r e n c e s [1] Banga, K., Tanti, L., Meulensteen, A., and Wiemer, J. (2009). Budgets, Batteries, and Barriers. Rbert F. Wagner Graduate Schl f Public Service, New Yrk University. Available frm %20Implementatin%20Issues%20fr%20NGOs.pdf. Retrieved 24 Octber [2] Jeffrey Cker, F., Basinger, M., and Mdi, V. (2010). Open Data Kit: Implicatins fr the Use f Smartphne Sftware Technlgy fr Questinnaire Studies in Internatinal Develpment. Clumbia University Mechanical Engineering Department.. Available frm Retrieved 24 Octber [3] Melissa Ludn, Pst: Mbile Phnes fr Data Cllectin. Available frm Retrieved 25 Octber [4] Online Database. Cmpiled by Nate Barthel and Mhini Bhavsar. VERSION, Dec 2, Mbile Data Cllectin Tls- Cmparisn Matrix. Available frm gid=0. Retrieved 20 December [5] Online Database. Cmpiled by MbileActive.rg (April/May 2010) fr UN Glbal Pulse ( Mbile Data Cllectin Inventry. Available frm Retrieved 13 Octber [6] Yu, P. et al. (2009). The develpment and evaluatin f a PDA-based methd fr public health surveillance data cllectin in develping cuntries, Int. J. Med. Infrm. 78(8): Available frm Retrieved 24 Octber [7] Presentatin held at Debrief meeting, UNHCR Geneva. Hibak, S., Sudhff, S. (Jan 2011). ANDROID phne , pwerpint. Nt nline available yet. Retrieved 13 January 2011.