Index>

20141015-import-doctor-data

Summary

• import detail data for a medical doctor from medregom

Commits

• https://github.com/ngiger/oddb.org/commit/fde8f8ee1ee6195d37b2ec0ce2ce6b37dc3dbcd3 First try with scraping data from medreg

Index

• import detail data for a medical doctor from medregom

Keep in Mind

• Fix dojo error http://www.sitepen.com/blog/2012/10/31/debugging-dojo-common-error-messages/#forgot-dom-ready
• I removed on May-27 tests for ix_registrationss, fix_sequences, fix_compositions, fix_packages from test/test_plugin/swissmedic.rb,as he could not find any references for them in the src code. Did I erroneously remove stuff when cleaning up the swissmedic import earlier?
• The whole test for older/newer Packages must be adapted to xlsx. One must compare the rows (e.g. by creating csv files) and do the same stuff in xlsx!

---

import detail data for a medical doctor from medregom

Using the search mask under http://www.medregom.admin.ch/DE one can find much many more details for a given medical doctor. Examples to use are:

• a young doctor 7601000972620
• a doctor with several additional qualifiaction 7601000254207 https://www.medreg.admin.ch/MedReg/Summary.aspx?IdPerson=4633
• docotor with several addresses 7601000523174, 7601000079107, 7601000019080

Shall we search via http://www.medregom.admin.ch/ or via https://www.medreg.admin.ch/MedReg/Summary.aspx?IdPerson=4633?

Found a direct link e.g http://www.medregom.admin.ch/de/Suche/Detail/?gln=7601000254207&vorname=Peter&name=Z%C3%BCst

Trying to test the search using watir before using mechanize. But when using watir I always get Die Personensuche dauerte zu lange. Bitte versuchen Sie es später noch einmal. under https://www.medreg.admin.ch/MedReg/PersonenSucheResultat.aspx. When using chromium manually it does not work neither.

The medregom is very slow when using it via watir as the page contains over 1800 elements. Therefore trying to use medreg.admin.ch. Try to add a plugin medreg_doctor.rb and a corresponding unit test. Using a new separate branch medreg for this work as it is a bigger feature.

I am at present unable to use mechanize to fill in the GLN https://www.medreg.admin.ch/MedReg/PersonenSuche.aspx correctly. When I submit the form, I only proceed to an empty site https://www.medreg.admin.ch/MedReg/PersonenSuche.aspx and I don't get redirected https://www.medreg.admin.ch/MedReg/PersonenSucheResultat.aspx. The page http://stackoverflow.com/questions/2566088/how-do-i-debug-a-nethttpinternalservererror-error-when-using-mechanize told me how to start logging the mechanize via

require 'logger'
@agent.log = Logger.new(STDOUT)

Also using pry to debug the whole interaction and comparing it with the output of HttpFox.

Using https://www.medreg.admin.ch/MedReg/Summary.aspx?IdPerson=20822 I see that with ID 200 we can harvest the data. Already got the diploma. But getting the information takes about 1,5 second for each doctor. Found entries with numbers as high as 75045. Which means that the task would run for over two days.