[Dachs-support] Issue with gz files?
Stéphane Erard
stephane.erard at obspm.fr
Fri Mar 29 10:42:43 CET 2019
Hello
I get this:
(first two lines do not block). This works if I use unzipped csv files.
dachs --traceback imp q
** WARNING: Somwhere near /var/gavo/inputs/vims_satellites/q.rd, (106, 57): Column image_specular_pixel may be null but has no explicit null value.
** WARNING: Somwhere near /var/gavo/inputs/vims_satellites/q.rd, (109, 57): Column image_limb_pixel may be null but has no explicit null value.
Making data vims_satellites/q#import
Starting /var/gavo/inputs/vims_satellites/data/vis_nav-2017.csv.gz
Failed /var/gavo/inputs/vims_satellites/data/vis_nav-2017.csv.gz
Done None, read 2013
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/gavo/user/cli.py", line 193, in main
funcToRun()
File "/usr/lib/python2.7/dist-packages/gavo/user/importing.py", line 187, in main
sys.exit(process(opts, args))
File "/usr/lib/python2.7/dist-packages/gavo/user/importing.py", line 111, in process
res = api.makeData(dd, parseOptions=opts, connection=connection)
File "/usr/lib/python2.7/dist-packages/gavo/rsc/data.py", line 459, in makeData
processSource(res, source, feeder, parseOptions, connection)
File "/usr/lib/python2.7/dist-packages/gavo/rsc/data.py", line 390, in processSource
_processSourceReal(data, source, feeder, opts)
File "/usr/lib/python2.7/dist-packages/gavo/rsc/data.py", line 372, in _processSourceReal
location=srcIter.getLocator()))
SourceParseError: At line 2014: AttributeError("'list' object has no attribute 'clear'",)
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/gavo/user/cli.py", line 193, in main
funcToRun()
File "/usr/lib/python2.7/dist-packages/gavo/user/importing.py", line 187, in main
sys.exit(process(opts, args))
File "/usr/lib/python2.7/dist-packages/gavo/user/importing.py", line 111, in process
res = api.makeData(dd, parseOptions=opts, connection=connection)
File "/usr/lib/python2.7/dist-packages/gavo/rsc/data.py", line 459, in makeData
processSource(res, source, feeder, parseOptions, connection)
File "/usr/lib/python2.7/dist-packages/gavo/rsc/data.py", line 390, in processSource
_processSourceReal(data, source, feeder, opts)
File "/usr/lib/python2.7/dist-packages/gavo/rsc/data.py", line 372, in _processSourceReal
location=srcIter.getLocator()))
SourceParseError: At line 2014: AttributeError("'list' object has no attribute 'clear'",)
*** Error: While parsing source
'/var/gavo/inputs/vims_satellites/data/vis_nav-2017.csv.gz', near line
2014:
AttributeError("'list' object has no attribute 'clear'",)
> Le 29 mars 2019 à 10:31, Markus Demleitner <msdemlei at ari.uni-heidelberg.de> a écrit :
>
> Dear Stéphane,
>
> On Thu, Mar 28, 2019 at 03:21:30PM +0100, Stéphane Erard wrote:
>> I’m trying to unzip source files in a q.rd, using csvGrammar.
>> From the doc, I'm writing
>>
>> <sources pattern="data/*.csv.gz" recurse="True"/>
>> <csvGrammar preFilter="zcat">
>> <rowfilter procDef="//products#define">
>> <bind name="table">"\schema.epn_core"</bind>
>> </rowfilter>
>> </csvGrammar>
>> etc
>>
>> but end up with
>> Failed /var/gavo/inputs/vims_satellites/data/vis_nav-2017.csv.gz
>> Done None, read 2013
>> *** Error: While parsing source
>> '/var/gavo/inputs/vims_satellites/data/vis_nav-2017.csv.gz', near line
>> 2014:
>> AttributeError("'list' object has no attribute 'clear’ »,)
>
> Hm, gzip is a red herring here, I think. But I'll need to know where
> DaCHS messes up.
>
> Could you run
>
> dachs --traceback imp q
>
> and send me the output?
>
> Thanks,
>
> Markus
> _______________________________________________
> Dachs-support mailing list
> Dachs-support at g-vo.org
> http://lists.g-vo.org/cgi-bin/mailman/listinfo/dachs-support
More information about the Dachs-support
mailing list