could not connect to www.swissreg.ch: #<Net::HTTPInternalServerError:0x007f8a7d69bb58>
---
Zeno remarked that the import_daily gets stuck when saving Konakion. Aborting locally import_bsv to be able to call
jobs/update_textinfo_swissmedicinfo --target=both 48112 --reparse
This does not lead to any problem. And the FI- and PI-files were created
ls -lrt /var/www/oddb.org/data/html/fachinfo/de/Konakion_\ MM\ paediatric_swissmedicinfo.* -rw-r--r-- 1 apache apache 5360 4. Feb 11:26 /var/www/oddb.org/data/html/fachinfo/de/Konakion_ MM paediatric_swissmedicinfo.styles -rw-r--r-- 1 apache apache 11707 4. Feb 11:26 /var/www/oddb.org/data/html/fachinfo/de/Konakion_ MM paediatric_swissmedicinfo.html -rw-r--r-- 1 apache apache 27482 4. Feb 11:26 /var/www/oddb.org/data/html/fachinfo/de/Konakion_ MM paediatric_swissmedicinfo.yaml ls -lrt /var/www/oddb.org/data/html/patinfo/de/Konakion_* -rw-r--r-- 1 apache apache 1011 4. Feb 11:26 /var/www/oddb.org/data/html/patinfo/de/Konakion_ MM_swissmedicinfo.styles -rw-r--r-- 1 apache apache 13940 4. Feb 11:26 /var/www/oddb.org/data/html/patinfo/de/Konakion_ MM_swissmedicinfo.html -rw-r--r-- 1 apache apache 18361 4. Feb 11:26 /var/www/oddb.org/data/html/patinfo/de/Konakion_ MM_swissmedicinfo.yaml
Running import_daily to see whether I have a problem now or not.
The RSS feed on thinpower did not show DHPC – Lariam® (Mefloquin)
See also http://feedly.com/e/xghGGYgt. The concerned URL is https://www.swissmedic.ch/marktueberwachung/00135/00157/01874/index.html?lang=de
I am using jobs/update_swissmedic_feeds. Found the problem. Entries which do not have date belonging to the current month don't get added. Verified that when adding a new item we send an e-mail, too. Fixed with commit Add entries even of a different month. Fix avoiding Archiv
When searching for trademark "Remeron SolTab" gives NoMethodError undefined method `has_patinfo?' for "":String
Zeno suspect a relation with the import-error on thinpower which looked like this:
Plugin: ODDB::BsvXmlPlugin
Error: NoMethodError
Message: undefined method `pointer' for "":String
@report: {:name_base=>"Remeron Soltab", :name_descr=>"Schmelztabl 30
mg ", :swissmedic_no5_bag=>"56075", :deductible=>:deductible_o,
:generic_type=>:original, :atc_class=>"N06AX11",
:pharmacode_bag=>"2563428", :swissmedic_no5_oddb=>"56075",
:swissmedic_no8_bag=>"56075052", :pharmacode_oddb=>"2563428"}
Backtrace:
/var/www/oddb.org/src/plugin/bsv_xml.rb:336:in `tag_end'
/usr/local/lib/ruby/1.9.1/rexml/parsers/streamparser.rb:26:in `parse'
/usr/local/lib/ruby/1.9.1/rexml/document.rb:205:in `parse_stream'
/var/www/oddb.org/src/plugin/bsv_xml.rb:1007:in `update_preparations'
/var/www/oddb.org/src/plugin/bsv_xml.rb:660:in `block (2 levels) in _update'
/var/www/oddb.org/vendor/bundle/ruby/1.9.1/gems/rubyzip-0.9.9/lib/zip/zip_entry.rb:502:in
`get_input_stream'
/var/www/oddb.org/src/plugin/bsv_xml.rb:660:in `block in _update'
/var/www/oddb.org/vendor/bundle/ruby/1.9.1/gems/rubyzip-0.9.9/lib/zip/zip_entry_set.rb:35:in
`each'
/var/www/oddb.org/vendor/bundle/ruby/1.9.1/gems/rubyzip-0.9.9/lib/zip/zip_entry_set.rb:35:in
`each'
/var/www/oddb.org/vendor/bundle/ruby/1.9.1/gems/rubyzip-0.9.9/lib/zip/zip_central_directory.rb:109:in
`each'
/var/www/oddb.org/vendor/bundle/ruby/1.9.1/gems/rubyzip-0.9.9/lib/zip/zip_file.rb:132:in
`block in foreach'
/var/www/oddb.org/vendor/bundle/ruby/1.9.1/gems/rubyzip-0.9.9/lib/zip/zip_file.rb:90:in
`open'
/var/www/oddb.org/vendor/bundle/ruby/1.9.1/gems/rubyzip-0.9.9/lib/zip/zip_file.rb:131:in
`foreach'
/var/www/oddb.org/src/plugin/bsv_xml.rb:655:in `_update'
/var/www/oddb.org/src/plugin/bsv_xml.rb:650:in `update'
/var/www/oddb.org/src/util/updater.rb:247:in `block in update_bsv'
/var/www/oddb.org/src/util/updater.rb:495:in `call'
/var/www/oddb.org/src/util/updater.rb:495:in `wrap_update'
/var/www/oddb.org/src/util/updater.rb:245:in `update_bsv'
jobs/import_bsv:14:in `block in <module:Util>'
/var/www/oddb.org/src/util/job.rb:40:in `call'
/var/www/oddb.org/src/util/job.rb:40:in `run'
jobs/import_bsv:12:in `<module:Util>'
jobs/import_bsv:11:in `<module:ODDB>'
jobs/import_bsv:10:in `<main>'
Rerunning the import_bsv job on oddb-ci2 to try to reproduce this error.
Playing around with bin/admin, I found the problem.
ch.oddb> registration('56075').packages[0].ikskey
-> 56075026
ch.oddb> registration('56075').packages[1].ikskey
-> 56075034
ch.oddb> registration('56075').packages[2].ikskey
->
ch.oddb> registration('56075').packages[3].ikskey
-> 56075058
The ikskey of package[2] is ''. Whereas it should bi '052' as seen by ch.oddb> registration('56075').packages[2].ikscd -> 052
What is weird is that, we have only 3 packages where the iksnr == 56075, but the registration('56075') has 4. As show with
ch.oddb> packages.find_all{|x| x.iksnr.eql?('56075') }.size
-> 3
ch.oddb> registration('56075').packages.size
-> 4
The import was done on Datum des Datenimports : 22.01.2014. Swissmedicinfo shows 4 packages.
The good news is, that it looks as we have only one problem of this kind, as shown by
ch.oddb> registration('56075').packages.find_all{|x| !x.iksnr }.size
-> 1
ch.oddb> packages.find_all{|x| !x.iksnr }.size
-> 1
ch.oddb> registration('56075').packages.find_all{|x| x.sequence.kind_of?(String) }.size
-> 1
ch.oddb> packages.find_all{|x| x.sequence.kind_of?(String) }.size
-> 1
Looking in the import logs of January 22 to try to find an explanation for the error. Found 10 entries in the file log/swissmedic.rb/2014/01.log The most relevant parties are:
2014-01-20 10:17:18 +0100: /var/www/oddb.org/src/plugin/swissmedic.rb: 67 changes: {
<..>
"56075"=>[:company],
<..>
log/swissmedic.rb/2014/01.log:2014-01-21 11:03:58 +0100: update_compositions: row[0] 56075 iksnr 56075 01 seq Remeron SolTab 15 mg, Schmelztabletten opts {:create_only=>false, :date=>#<Date: 2014-01-21 ((2456679j,0s,0n),+0s,2299161j)>, :composition=>0, :label=>nil} cell_content mirtazapinum 15 mg, sacchari sphaerae, arom.: vanillinum et alia, aspartamum, excipiens pro compresso.
log/swissmedic.rb/2014/01.log:2014-01-21 11:04:00 +0100: update_compositions: row[0] 56075 iksnr 56075 01 seq Remeron SolTab 15 mg, Schmelztabletten opts {:create_only=>false, :date=>#<Date: 2014-01-21 ((2456679j,0s,0n),+0s,2299161j)>, :composition=>0, :label=>nil} cell_content mirtazapinum 15 mg, sacchari sphaerae, arom.: vanillinum et alia, aspartamum, excipiens pro compresso.
log/swissmedic.rb/2014/01.log:2014-01-21 11:04:02 +0100: update_compositions: row[0] 56075 iksnr 56075 02 seq Remeron SolTab 30 mg, Schmelztabletten opts {:create_only=>false, :date=>#<Date: 2014-01-21 ((2456679j,0s,0n),+0s,2299161j)>, :composition=>0, :label=>nil} cell_content mirtazapinum 30 mg, sacchari sphaerae, arom.: vanillinum et alia, aspartamum, excipiens pro compresso.
log/swissmedic.rb/2014/01.log:2014-01-21 11:04:04 +0100: update_compositions: row[0] 56075 iksnr 56075 02 seq Remeron SolTab 30 mg, Schmelztabletten opts {:create_only=>false, :date=>#<Date: 2014-01-21 ((2456679j,0s,0n),+0s,2299161j)>, :composition=>0, :label=>nil} cell_content mirtazapinum 30 mg, sacchari sphaerae, arom.: vanillinum et alia, aspartamum, excipiens pro compresso.
It seems, that only the company name changed. I think the best solution is to delete the package in question and wait for the next import to fill it. This could be done in bin/admin delete @system.registration('56075').packages[2].pointer. Now the search on oddb-ci2 for "Remeron Soltab" returns 3 packages. Rerunning the import. Also calling in another bin/admin Updater.new(self).export_oddb_csv to see, whether we fixed this problem, too. The report completed without problems and did send me an email. Same for export_index_therapeuticus_csv and export_oddb2_csv. Called also Exporter.new(self).export_price_history_csv.
Trying to fix this error by reimporting the FI, e.g bundle exec jobs/update_textinfo_swissmedicinfo --target=both 56075 --reparse. This did not work, as it keeps all sequences/packages only locally.
In bin/admin
@registration('56075').sequences['02'].create_package('052')
this should do the trick. Afterwards I did see 4 packages http://oddb-ci2.dyndns.org/de/gcc/search/zone/drugs/search_query/Remeron%20SolTab/search_type/st_sequence#best_result. Stopping and restarting bin/oddbd, the fourth package has vanished. Must probably call self.odba_isolated_store. Did not work.
Tried
@sequence = registration('56075').sequences['02']; @package = @sequence.create_package('052'); @part = @package.create_part; @res = update(@sequence.pointer, {:packages => @sequence.packages}, :swissmedic_text_info)
and got not further.
Adding a odba_store to the sequence and calling
@sequence = registration('56075').sequences['02']; @package = @sequence.create_package('052'); @part = @package.create_part; @res = update(@sequence.pointer, {:packages => @sequence.packages}, :swissmedic_text_info); @sequence.odba_store
This worked like a charm. Also after restarting bin/oddbd. Executing command on thinpower too.
Now calling the import_bsv on oddb-ci2.