migel
---
The atc_less jobs need two small modifications:
Running corrected job atc_less via swissmedic_followers. It took 3,5 minutes to be rebuilt.
Looking at the received mail I find inconsistent results: eg.
440 ATC code taken from swissindex where they are longer 00282/01 J06AA99 -> J06AA99 00288/01 J06AA99 -> J06AA99 <..> 41080/03 N02 -> M02AC
Okay. I found the error compared the code from swissindex to the one from swissmedic and not to that from the database. Corrected. Rerunning the import again. Fix is not correct as an atc_code from swissindex gets overriden by the one from swissmedic. Distinguish in the report between nr_atc_code_from_swissmedic and nr_atc_code_from_swissindex. Now it looks better. Redoing import again, as now everything should be okay.
Pushed commits:
Started jobs/update_atc_less in a screen on thinpower.
Must adapt the new link and putting it into /var/www/migel/etc/migel.yml
Migel-Update does not work anymore as it should.
Last good update was
---------- Forwarded message ---------- From: <admin@ywesee.com> Date: 2014-06-03 3:22 GMT+02:00 Subject: Tue Jun 3 02:55:22 2014: migel Migel::Util::Importer#reported_save_all_products(fr) To: Tue Jun 3 02:55:22 2014: migel Migel::Util::Importer#reported_save_all_products(fr) Saved file: /var/www/migel/data/csv/migel_product_fr.csv Total 557 Migelids ( 375 Migelids have products / 182 Migelids have no products) Saved 32187 Products Migelids with products (375) http://ch.oddb.org/fr/gcc/migel_search/migel_product/010101001 <...> Migelids without products (182) http://ch.oddb.org/fr/gcc/migel_search/migel_product/010102012 <..>
It contained also one attachement migel_products_fr.csv.gz
Looking at my E-Mails I found one which looked like this
Thu Sep 4 08:06:24 2014: migel Migel::Util::Importer#reported_save_all_products(de) Saved file: /var/www/migel/data/csv/migel_products_de.csv Total 567 Migelids ( 375 Migelids have products / 192 Migelids have no products) Saved 32187 Products Migelids with products (375) http://ch.oddb.org/de/gcc/migel_search/migel_product/010101001
It had also an attachment migel_products_de.csv.gz
which was about 460 kB big.
I find however the following commit of mine which was not pushed
commit c1236037439852837180e4f155482ea6d4cef1d8 Author: Niklaus Giger <niklaus.giger@member.fsf.org> Date: Thu Sep 4 08:06:09 2014 +0200 Avoid nil error when migel id/group/subgroup is empty
Running unchanged jobs/update_migel_products_with_report to see what happens. See that it downloaded the file -rw-r--r-- 1 apache apache 8192207 2. Feb 14:16 data/xml/XMLSwissindexNonPharma-DE-latest.xml
The big difference I have between thinpower and oddb-ci2 is that on thinpower a different database migel is used.
I found probably the culprit in lib/migel/plugin/swissindex.rb I return migel_codes_without_products instad of the @migel_codes_without_products.
But another problem is that the migel job calls ch.oddb-swissindex_pharma to get the content for the Migel-items.
For oddbd we use an old version of Savon (0.9.7) which is used to get the ZSR and Swissindex. The actual Savon version 2.9.0 would make testing a lot easier.
Found an easy way to add simple check that our new base_url works. Pushed commit Make migel base_url configurabl.
Pushed two commits for migel, too:
Pulling changes to thinpower. Restarting ch-oddbd* and starting migel import