[Dachs-support] Issue with gz files?

Stéphane Erard stephane.erard at obspm.fr
Fri Mar 29 10:42:43 CET 2019


Hello


I get this:
(first two lines do not block). This works if I use unzipped csv files.


dachs --traceback imp q
** WARNING: Somwhere near /var/gavo/inputs/vims_satellites/q.rd, (106, 57):  Column image_specular_pixel may be null but has no explicit null value.
** WARNING: Somwhere near /var/gavo/inputs/vims_satellites/q.rd, (109, 57):  Column image_limb_pixel may be null but has no explicit null value.
Making data vims_satellites/q#import
Starting /var/gavo/inputs/vims_satellites/data/vis_nav-2017.csv.gz
Failed /var/gavo/inputs/vims_satellites/data/vis_nav-2017.csv.gz
Done None, read 2013
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/gavo/user/cli.py", line 193, in main
    funcToRun()
  File "/usr/lib/python2.7/dist-packages/gavo/user/importing.py", line 187, in main
    sys.exit(process(opts, args))
  File "/usr/lib/python2.7/dist-packages/gavo/user/importing.py", line 111, in process
    res = api.makeData(dd, parseOptions=opts, connection=connection)
  File "/usr/lib/python2.7/dist-packages/gavo/rsc/data.py", line 459, in makeData
    processSource(res, source, feeder, parseOptions, connection)
  File "/usr/lib/python2.7/dist-packages/gavo/rsc/data.py", line 390, in processSource
    _processSourceReal(data, source, feeder, opts)
  File "/usr/lib/python2.7/dist-packages/gavo/rsc/data.py", line 372, in _processSourceReal
    location=srcIter.getLocator()))
SourceParseError: At line 2014: AttributeError("'list' object has no attribute 'clear'",)
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/gavo/user/cli.py", line 193, in main
    funcToRun()
  File "/usr/lib/python2.7/dist-packages/gavo/user/importing.py", line 187, in main
    sys.exit(process(opts, args))
  File "/usr/lib/python2.7/dist-packages/gavo/user/importing.py", line 111, in process
    res = api.makeData(dd, parseOptions=opts, connection=connection)
  File "/usr/lib/python2.7/dist-packages/gavo/rsc/data.py", line 459, in makeData
    processSource(res, source, feeder, parseOptions, connection)
  File "/usr/lib/python2.7/dist-packages/gavo/rsc/data.py", line 390, in processSource
    _processSourceReal(data, source, feeder, opts)
  File "/usr/lib/python2.7/dist-packages/gavo/rsc/data.py", line 372, in _processSourceReal
    location=srcIter.getLocator()))
SourceParseError: At line 2014: AttributeError("'list' object has no attribute 'clear'",)
*** Error: While parsing source
'/var/gavo/inputs/vims_satellites/data/vis_nav-2017.csv.gz', near line
2014:

AttributeError("'list' object has no attribute 'clear'",)


> Le 29 mars 2019 à 10:31, Markus Demleitner <msdemlei at ari.uni-heidelberg.de> a écrit :
> 
> Dear Stéphane,
> 
> On Thu, Mar 28, 2019 at 03:21:30PM +0100, Stéphane Erard wrote:
>> I’m trying to unzip source files in a q.rd, using csvGrammar.
>> From the doc, I'm writing  
>> 
>> <sources pattern="data/*.csv.gz" recurse="True"/>
>> 		<csvGrammar preFilter="zcat">
>> 			<rowfilter procDef="//products#define">
>> 				<bind name="table">"\schema.epn_core"</bind>
>> 			</rowfilter>
>> 		</csvGrammar>
>> etc
>> 
>> but end up with 
>> Failed /var/gavo/inputs/vims_satellites/data/vis_nav-2017.csv.gz
>> Done None, read 2013
>> *** Error: While parsing source
>> '/var/gavo/inputs/vims_satellites/data/vis_nav-2017.csv.gz', near line
>> 2014:
>> AttributeError("'list' object has no attribute 'clear’ »,)
> 
> Hm, gzip is a red herring here, I think.  But I'll need to know where
> DaCHS messes up.
> 
> Could you run
> 
> dachs --traceback imp q
> 
> and send me the output?
> 
> Thanks,
> 
>        Markus
> _______________________________________________
> Dachs-support mailing list
> Dachs-support at g-vo.org
> http://lists.g-vo.org/cgi-bin/mailman/listinfo/dachs-support




More information about the Dachs-support mailing list