Empty lines in some Vizier queries #2699
Description
I am running into an issue with a Vizier query which occasionally returns an extra (mostly empty) row - unfortunately it is not systematically reproducible, but inspecting the picked request, the request was essentially:
r = requests.post('http://vizier.u-strasbg.fr/viz-bin/votable',
data='-source=I/355/gaiadr3\n-out=*,G-RP,VarFlag\n-out.add=_q\n-out.max=unlimited\n-c.rs=2.0\n-out.meta=huUD\n-out.form=mini\n-oc.form=d\n-c=<<====AstroqueryList\n243.80288700-68.87621600\n188.66620800-79.35896940\n183.20826900-79.75720400\n155.98412500-56.84311667\n268.39973300-59.65393800\n270.72667900-55.84180700\n91.43149700-51.97702200\n118.99454170-52.35483000\n49.88658300-1.23793000\n57.65720830-15.02622500\n78.71979167-29.72966100\n129.57204170-23.55021670\n130.80012500-83.06125830\n320.91654170-62.92380278\n339.35783300-53.31905000\n301.99904170-70.61559167\n268.19808700-45.08280600\n256.44018000-30.81670700\n229.73095100-44.50039900\n219.47697600-46.28512200\n====AstroqueryList',
headers= {'User-Agent': 'astroquery/0.4.7.dev8558 python-requests/2.28.2', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Content-Length': '604'})Most of the time, it returns:
_q RA_ICRS DE_ICRS Source e_RA_ICRS e_DE_ICRS Plx e_Plx PM pmRA e_pmRA ... AllWISE APASS9 GSC23 RAVE5 _2MASS RAVE6 RAJ2000 DEJ2000 G-RP VarFlag
deg deg mas mas mas mas mas / yr mas / yr mas / yr ... deg deg mag
--- --------------- --------------- ------------------- --------- --------- --------- ------- --------- --------- -------- ... ------------------- -------- ---------- ----- ---------------- ----- --------------- --------------- --------- -------------
1 243.80288328131 -68.87621868597 5820931075628056192 0.0061 0.0078 2.4592 0.0112 21.679 -10.438 0.007 ... J161512.71-685234.1 48080106 S7UB000777 16151271-6852340 243.80301200804 -68.87613423764 0.557189 VARIABLE
2 188.66620162601 -79.35896630187 5787563165458243200 0.0100 0.0099 4.5161 0.0114 18.106 8.372 0.012 ... J123439.88-792132.3 47426261 S79V000161 12343983-7921325 188.66600011725 -79.35903765273 0.716385 NOT_AVAILABLE
3 183.20823753450 -79.75720221551 5787442146160163200 0.0103 0.0092 2.6531 0.0117 42.319 -39.544 0.013 ... J121250.06-794525.9 47425145 S74W000302 12125018-7945261 183.20922590697 -79.75726919611 0.605746 NOT_AVAILABLE
4 155.98413662753 -56.84311578364 5351820556994135296 0.0099 0.0095 2.7890 0.0116 25.314 -24.075 0.013 ... J102356.21-565035.2 41005958 S488000228 10235624-5650353 155.98433226190 -56.84315055918 0.379813 NOT_AVAILABLE
5 268.39973454555 -59.65393910747 5917815019440136576 0.0123 0.0114 1.8435 0.0133 11.319 6.658 0.014 ... J175335.93-593914.1 50849020 S7FH000606 17533593-5939139 268.39967597923 -59.65389842434 0.482858 NOT_AVAILABLE
6 270.72667984178 -55.84180815185 6652182688220446336 2.3917 2.4900 -- -- -- -- -- ... J180254.40-555030.4 58634954 SAOG000527 18025440-5550304 270.72667984178 -55.84180815185 0.621442 NOT_AVAILABLE
7 91.43149529372 -51.97702200508 5549622385278008960 0.0090 0.0096 2.6682 0.0095 9.568 -9.140 0.011 ... J060543.56-515837.2 43846989 S4D7000060 06054358-5158372 91.43156124127 -51.97703458115 0.470409 NOT_AVAILABLE
8 118.99453863872 -52.35483052563 5513558648705418368 0.0132 0.0138 3.3565 0.0150 23.718 14.954 0.017 ... J075558.68-522117.5 43241895 S607000362 07555866-5221177 118.99442981899 -52.35491234418 0.577823 NOT_AVAILABLE
9 49.88658352335 -1.23793550297 3262611437562565376 0.0134 0.0115 1.8573 0.0161 14.356 3.803 0.015 ... J031932.77-011416.4 23468887 S1SB000126 03193277-0114162 49.88656661576 -1.23787397761 0.509472 NOT_AVAILABLE
10 57.65723159651 -15.02622877948 5110565749968529024 0.0191 0.0144 3.4829 0.0232 37.812 26.874 0.024 ... J035037.72-150134.2 37735510 S1V0000199 03503769-1501339 57.65710792973 -15.02611055484 0.491079 NOT_AVAILABLE
11 78.71979518994 -29.72965284759 2954369296952014976 0.0088 0.0106 5.0643 0.0123 68.808 4.073 0.011 ... J051452.75-294347.0 19190876 S262000158 05145274-2943478 78.71977434447 -29.72995812638 0.765096 NOT_AVAILABLE
12 129.57202150688 -23.55021655167 5701679002245319296 0.0098 0.0087 3.5377 0.0121 4.787 -3.768 0.012 ... J083817.28-233300.8 46258271 S5ST000010 08381729-2333007 129.57203977373 -23.55022967614 0.449464 NOT_AVAILABLE
13 130.80017770277 -83.06126574743 5195197358981981824 0.0120 0.0117 7.4183 0.0129 72.708 41.724 0.018 ... J084311.89-830340.2 37965788 S3ZN000106 08431167-8303395 130.79864274554 -83.06100110039 0.535774 NOT_AVAILABLE
14 320.91653039230 -62.92380478840 6403410932527700992 0.0062 0.0080 2.2392 0.0111 8.406 -3.601 0.009 ... 57366489 SAWB000099 21233996-6255256 320.91656555069 -62.92377102703 0.456399 NOT_AVAILABLE
15 339.35784688422 -53.31905883805 6507438682567821568 0.0078 0.0095 2.1683 0.0132 94.772 70.293 0.011 ... J223725.83-531908.2 57982239 SAN4000302 22372575-5319076 339.35732389546 -53.31877632342 0.469915 NOT_AVAILABLE
16 301.99904516724 -70.61559264535 6422566276211752960 0.0068 0.0090 2.9754 0.0111 21.067 18.169 0.009 ... J200759.74-703656.0 57487439 SAXH000615 20075971-7036558 301.99880187770 -70.61554525242 0.513882 NOT_AVAILABLE
17 268.19808798259 -45.08280739906 5954646563023237888 0.0179 0.0148 1.5360 0.0191 7.358 2.891 0.021 ... J175247.53-450457.9 51815865 S8OW000483 17524753-4504579 268.19806978526 -45.08277732534 0.402145 NOT_AVAILABLE
18 256.44017091530 -30.81670945170 6028534676521195392 2.0338 1.0434 -- -- -- -- -- ... J170545.64-304900.1 53259347 S8GO135543 17054564-3049001 256.44017091530 -30.81670945170 0.544202 NOT_AVAILABLE
19 229.73094694827 -44.50040073036 6000355980122779904 0.0560 0.0461 4.1122 0.0699 27.315 -22.655 0.090 ... J151855.43-443001.2 52721865 S9CQ000636 15185545-4430011 229.73108811928 -44.50033290822 0.491667 NOT_AVAILABLE
20 219.47697332169 -46.28512247908 6098138465445114880 0.1011 0.1150 2.6729 0.1718 12.602 -12.276 0.179 ... J143754.48-461706.3 54772776 S9D0001461 14375449-4617063 219.47705227052 -46.28510982801 0.408924 NOT_AVAILABLE
but occasionally it returns:
_q RA_ICRS DE_ICRS Source e_RA_ICRS e_DE_ICRS Plx e_Plx PM pmRA e_pmRA ... AllWISE APASS9 GSC23 RAVE5 _2MASS RAVE6 RAJ2000 DEJ2000 G-RP VarFlag
deg deg mas mas mas mas mas / yr mas / yr mas / yr ... deg deg mag
--- --------------- --------------- ------------------- --------- --------- --------- ------- --------- --------- -------- ... ------------------- -------- ---------- ----- ---------------- ----- --------------- --------------- --------- -------------
1 243.80288328131 -68.87621868597 5820931075628056192 0.0061 0.0078 2.4592 0.0112 21.679 -10.438 0.007 ... J161512.71-685234.1 48080106 S7UB000777 16151271-6852340 243.80301200804 -68.87613423764 0.557189 VARIABLE
2 188.66620162601 -79.35896630187 5787563165458243200 0.0100 0.0099 4.5161 0.0114 18.106 8.372 0.012 ... J123439.88-792132.3 47426261 S79V000161 12343983-7921325 188.66600011725 -79.35903765273 0.716385 NOT_AVAILABLE
3 183.20823753450 -79.75720221551 5787442146160163200 0.0103 0.0092 2.6531 0.0117 42.319 -39.544 0.013 ... J121250.06-794525.9 47425145 S74W000302 12125018-7945261 183.20922590697 -79.75726919611 0.605746 NOT_AVAILABLE
4 155.98413662753 -56.84311578364 5351820556994135296 0.0099 0.0095 2.7890 0.0116 25.314 -24.075 0.013 ... J102356.21-565035.2 41005958 S488000228 10235624-5650353 155.98433226190 -56.84315055918 0.379813 NOT_AVAILABLE
4 -- -- -- -- -- -- -- -- -- -- ... -- -- -- --
5 268.39973454555 -59.65393910747 5917815019440136576 0.0123 0.0114 1.8435 0.0133 11.319 6.658 0.014 ... J175335.93-593914.1 50849020 S7FH000606 17533593-5939139 268.39967597923 -59.65389842434 0.482858 NOT_AVAILABLE
6 270.72667984178 -55.84180815185 6652182688220446336 2.3917 2.4900 -- -- -- -- -- ... J180254.40-555030.4 58634954 SAOG000527 18025440-5550304 270.72667984178 -55.84180815185 0.621442 NOT_AVAILABLE
7 91.43149529372 -51.97702200508 5549622385278008960 0.0090 0.0096 2.6682 0.0095 9.568 -9.140 0.011 ... J060543.56-515837.2 43846989 S4D7000060 06054358-5158372 91.43156124127 -51.97703458115 0.470409 NOT_AVAILABLE
8 118.99453863872 -52.35483052563 5513558648705418368 0.0132 0.0138 3.3565 0.0150 23.718 14.954 0.017 ... J075558.68-522117.5 43241895 S607000362 07555866-5221177 118.99442981899 -52.35491234418 0.577823 NOT_AVAILABLE
9 49.88658352335 -1.23793550297 3262611437562565376 0.0134 0.0115 1.8573 0.0161 14.356 3.803 0.015 ... J031932.77-011416.4 23468887 S1SB000126 03193277-0114162 49.88656661576 -1.23787397761 0.509472 NOT_AVAILABLE
10 57.65723159651 -15.02622877948 5110565749968529024 0.0191 0.0144 3.4829 0.0232 37.812 26.874 0.024 ... J035037.72-150134.2 37735510 S1V0000199 03503769-1501339 57.65710792973 -15.02611055484 0.491079 NOT_AVAILABLE
11 78.71979518994 -29.72965284759 2954369296952014976 0.0088 0.0106 5.0643 0.0123 68.808 4.073 0.011 ... J051452.75-294347.0 19190876 S262000158 05145274-2943478 78.71977434447 -29.72995812638 0.765096 NOT_AVAILABLE
12 129.57202150688 -23.55021655167 5701679002245319296 0.0098 0.0087 3.5377 0.0121 4.787 -3.768 0.012 ... J083817.28-233300.8 46258271 S5ST000010 08381729-2333007 129.57203977373 -23.55022967614 0.449464 NOT_AVAILABLE
13 130.80017770277 -83.06126574743 5195197358981981824 0.0120 0.0117 7.4183 0.0129 72.708 41.724 0.018 ... J084311.89-830340.2 37965788 S3ZN000106 08431167-8303395 130.79864274554 -83.06100110039 0.535774 NOT_AVAILABLE
14 320.91653039230 -62.92380478840 6403410932527700992 0.0062 0.0080 2.2392 0.0111 8.406 -3.601 0.009 ... 57366489 SAWB000099 21233996-6255256 320.91656555069 -62.92377102703 0.456399 NOT_AVAILABLE
15 339.35784688422 -53.31905883805 6507438682567821568 0.0078 0.0095 2.1683 0.0132 94.772 70.293 0.011 ... J223725.83-531908.2 57982239 SAN4000302 22372575-5319076 339.35732389546 -53.31877632342 0.469915 NOT_AVAILABLE
16 301.99904516724 -70.61559264535 6422566276211752960 0.0068 0.0090 2.9754 0.0111 21.067 18.169 0.009 ... J200759.74-703656.0 57487439 SAXH000615 20075971-7036558 301.99880187770 -70.61554525242 0.513882 NOT_AVAILABLE
17 268.19808798259 -45.08280739906 5954646563023237888 0.0179 0.0148 1.5360 0.0191 7.358 2.891 0.021 ... J175247.53-450457.9 51815865 S8OW000483 17524753-4504579 268.19806978526 -45.08277732534 0.402145 NOT_AVAILABLE
18 256.44017091530 -30.81670945170 6028534676521195392 2.0338 1.0434 -- -- -- -- -- ... J170545.64-304900.1 53259347 S8GO135543 17054564-3049001 256.44017091530 -30.81670945170 0.544202 NOT_AVAILABLE
19 229.73094694827 -44.50040073036 6000355980122779904 0.0560 0.0461 4.1122 0.0699 27.315 -22.655 0.090 ... J151855.43-443001.2 52721865 S9CQ000636 15185545-4430011 229.73108811928 -44.50033290822 0.491667 NOT_AVAILABLE
20 219.47697332169 -46.28512247908 6098138465445114880 0.1011 0.1150 2.6729 0.1718 12.602 -12.276 0.179 ... J143754.48-461706.3 54772776 S9D0001461 14375449-4617063 219.47705227052 -46.28510982801 0.408924 NOT_AVAILABLE
Notice the duplicate _q == 4 and the empty line the second time it appears. I suspect this is a Vizier server issue as the returned VOTable has the problem (so not an issue with VO table parsing):
<TR><TD>3</TD><TD>183.20823753450</TD><TD>-79.75720221551</TD><TD>5787442146160163200</TD><TD>0.0103</TD><TD>0.0092</TD><TD>2.6531</TD><TD>0.0117</TD><TD>42.319</TD><TD>-39.544</TD><TD>0.013</TD><TD>15.071</TD><TD>0.013</TD><TD>0.981</TD><TD>259284.27788</TD><TD>4.5471e+01</TD><TD>12.152926</TD><TD>1.2640e+05</TD><TD>7.8378e+01</TD><TD>12.584185</TD><TD>1.9067e+05</TD><TD>6.2624e+01</TD><TD>11.547180</TD><TD>1.037004</TD><TD>11.24</TD><TD>0.50</TD><TD>6.6030</TD><TD>11.313940</TD><TD>0</TD><TD>0</TD><TD>0</TD><TD>1</TD><TD>1</TD><TD>1</TD><TD>0</TD><TD>0</TD><TD>1</TD><TD>1</TD><TD>0</TD><TD>5727.5</TD><TD>4.0169</TD><TD>-0.3076</TD><TD>381.4152</TD><TD>0.5746</TD><TD></TD><TD></TD><TD></TD><TD>407634041</TD><TD></TD><TD></TD><TD>J121250.06-794525.9</TD><TD>47425145</TD><TD>S74W000302</TD><TD></TD><TD>12125018-7945261</TD><TD></TD><TD>183.20922590697</TD><TD>-79.75726919611</TD><TD>0.605746</TD><TD>NOT_AVAILABLE</TD></TR>
<TR><TD>4</TD><TD>155.98413662753</TD><TD>-56.84311578364</TD><TD>5351820556994135296</TD><TD>0.0099</TD><TD>0.0095</TD><TD>2.7890</TD><TD>0.0116</TD><TD>25.314</TD><TD>-24.075</TD><TD>0.013</TD><TD>7.825</TD><TD>0.011</TD><TD>0.929</TD><TD>983093.40366</TD><TD>1.3399e+02</TD><TD>10.705880</TD><TD>5.7715e+05</TD><TD>1.9655e+02</TD><TD>10.935315</TD><TD>5.8713e+05</TD><TD>1.3391e+02</TD><TD>10.326067</TD><TD>0.609248</TD><TD>9.34</TD><TD>0.54</TD><TD>18.6008</TD><TD>10.177995</TD><TD>0</TD><TD>0</TD><TD>0</TD><TD>1</TD><TD>1</TD><TD>0</TD><TD>0</TD><TD>0</TD><TD>1</TD><TD>1</TD><TD>0</TD><TD>6568.7</TD><TD>4.0537</TD><TD>-0.1667</TD><TD>358.2940</TD><TD>0.1134</TD><TD></TD><TD></TD><TD></TD><TD>429766487</TD><TD>8608-2176-1</TD><TD></TD><TD>J102356.21-565035.2</TD><TD>41005958</TD><TD>S488000228</TD><TD></TD><TD>10235624-5650353</TD><TD></TD><TD>155.98433226190</TD><TD>-56.84315055918</TD><TD>0.379813</TD><TD>NOT_AVAILABLE</TD></TR>
<TR><TD>4</TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD><TD></TD></TR>
<TR><TD>5</TD><TD>268.39973454555</TD><TD>-59.65393910747</TD><TD>5917815019440136576</TD><TD>0.0123</TD><TD>0.0114</TD><TD>1.8435</TD><TD>0.0133</TD><TD>11.319</TD><TD>6.658</TD><TD>0.014</TD><TD>-9.154</TD><TD>0.013</TD><TD>0.917</TD><TD>100493.79701</TD><TD>2.5627e+01</TD><TD>13.182018</TD><TD>5.4465e+04</TD><TD>3.1576e+01</TD><TD>13.498240</TD><TD>6.5992e+04</TD><TD>3.0113e+01</TD><TD>12.699161</TD><TD>0.799080</TD><TD>-20.54</TD><TD>2.76</TD><TD></TD><TD>12.500937</TD><TD>0</TD><TD>0</TD><TD>0</TD><TD>1</TD><TD>1</TD><TD>0</TD><TD>0</TD><TD>0</TD><TD>1</TD><TD>1</TD><TD>0</TD><TD>6043.3</TD><TD>4.3842</TD><TD>-0.4227</TD><TD>534.8029</TD><TD>0.1832</TD><TD></TD><TD></TD><TD></TD><TD>372954567</TD><TD></TD><TD></TD><TD>J175335.93-593914.1</TD><TD>50849020</TD><TD>S7FH000606</TD><TD></TD><TD>17533593-5939139</TD><TD></TD><TD>268.39967597923</TD><TD>-59.65389842434</TD><TD>0.482858</TD><TD>NOT_AVAILABLE</TD></TR>
``