20111208-check-parallel-importer-oddb_org-migel-importer-ruby193

<< Masa.20111209-compatible-update-ywesee-libs-ruby193-186 | 2011 | Masa.20111207-check-parallel-importer-oddb_org-migel-importer-ruby193 >>

1. Check the result of parallel importers oddb.org
2. Testcases ODBA
3. Debug migel importer on Ruby 1.9.3
4. Update Ruby 1.9.3 changes of ywesee libraries into Ruby 1.8.6 compatibles

Goal/Estimate/Evaluation

• Checl parallel import oddb.org / 80% / 100%
• Testcases odba, oddb.org / 100% / 100%
• migel importer on Ruby 1.9.3 / 80% / 100%

Milestones

1. check parallel importer oddb.org (odba) locally
2. odba testcases
3. migel importer
4. compatible updates ywesee libs for Ruby 1.9.3 and Ruby 1.8.6

Commit

• Added file lock exclusive control to create a new odba_id between processes (odba)
• Added rescue statement to skip missing or corrupted package data during csv export process (oddb.org)
• Added testcases for file lock exclusive control for a new odba_id (odba)
• Updated testcases for ODBA ver 1.0.1 (oddb.org)

Check the result of parallel importers oddb.org

Failed

• export_oddb_csv (Data Error)
• export_oddb2_csv (Data Error)
• export_ouwerkerk (Data Error)
• export_generics_xls (DRbConnError, 10005)
• update_comarketing (DRbConnError, 10008)
• update_swissreg (DRbConnError,10007)
• update_medwin_companies (DRbConnError, 10006)

Error (export_oddb_csv)

• Email ch.ODDB.org Report - Error: oddb.csv - 07/12/2011

Plugin: ODDB::CsvExportPlugin
Error: RuntimeError
Message: undefined method `bsv_dossier' for nil:NilClass package ean code=7680518300408
Backtrace:
/home/masa/ywesee/oddb.org/src/view/drugs/csv_result.rb:79:in `bsv_dossier'
/home/masa/ywesee/oddb.org/src/view/drugs/csv_result.rb:331:in `send'
/home/masa/ywesee/oddb.org/src/view/drugs/csv_result.rb:331:in `to_csv'
/home/masa/ywesee/oddb.org/src/view/drugs/csv_result.rb:329:in `collect'
/home/masa/ywesee/oddb.org/src/view/drugs/csv_result.rb:329:in `to_csv'
/home/masa/ywesee/oddb.org/src/view/drugs/csv_result.rb:327:in `each'
/home/masa/ywesee/oddb.org/src/view/drugs/csv_result.rb:327:in `to_csv'
/home/masa/ywesee/oddb.org/src/view/drugs/csv_result.rb:325:in `each'
/home/masa/ywesee/oddb.org/src/view/drugs/csv_result.rb:325:in `to_csv'
/home/masa/ywesee/oddb.org/src/view/drugs/csv_result.rb:346:in `to_csv_file'
/home/masa/ywesee/oddb.org/src/view/drugs/csv_result.rb:346:in `open'
/home/masa/ywesee/oddb.org/src/view/drugs/csv_result.rb:346:in `to_csv_file'
/home/masa/ywesee/oddb.org/src/plugin/csv_export.rb:55:in `_export_drugs'
/home/masa/ywesee/oddb.org/src/plugin/csv_export.rb:25:in `export_drugs'
/home/masa/ywesee/oddb.org/src/util/updater.rb:84:in `export_oddb_csv'
/home/masa/ywesee/oddb.org/src/util/updater.rb:477:in `call'
/home/masa/ywesee/oddb.org/src/util/updater.rb:477:in `wrap_update'
/home/masa/ywesee/oddb.org/src/util/updater.rb:82:in `export_oddb_csv'
/home/masa/ywesee/oddb.org/src/util/updater.rb:270:in `update_bsv_followers'
jobs/import_bsv:15
/home/masa/ywesee/oddb.org/src/util/job.rb:17:in `call'
/home/masa/ywesee/oddb.org/src/util/job.rb:17:in `run'
jobs/import_bsv:12

Commit

• Added file lock exclusive control to create a new odba_id between processes (odba)
• Added rescue statement to skip missing or corrupted package data during csv export process (oddb.org)

Testcases ODBA

Commit

• Added testcases for file lock exclusive control for a new odba_id (odba)
• Updated testcases for ODBA ver 1.0.1 (oddb.org)

Debug migel importer on Ruby 1.9.3

Refer to http://dev.ywesee.com/wiki.php/Choddb/MiGelChangelog#importer_20111208

Update Ruby 1.9.3 changes of ywesee libraries into Ruby 1.8.6 compatibles