About URL table engine and url function

[gangtao]

following query works in proton, which is good

SELECT
  ip_range_start, ip_range_end, country_code, state1, state2, city, postcode, latitude, longitude, timezone
FROM
  url('https://raw.githubusercontent.com/sapics/ip-location-db/master/dbip-city/dbip-city-ipv4.csv.gz', 'CSV', 'ip_range_start ipv4, ip_range_end ipv4, country_code nullable(string), state1 nullable(string), state2 nullable(string), city nullable(string), postcode nullable(string), latitude float64, longitude float64, timezone nullable(string)')
LIMIT 10

following DDL works as well but query the stream will return run time error

create stream geoip_url(
    ip_range_start ipv4, 
    ip_range_end ipv4, 
    country_code nullable(string), 
    state1 nullable(string), 
    state2 nullable(string), 
    city nullable(string), 
    postcode nullable(string), 
    latitude float64, 
    longitude float64, 
    timezone nullable(string)
) engine=URL('https://raw.githubusercontent.com/sapics/ip-location-db/master/dbip-city/dbip-city-ipv4.csv.gz', 'CSV');

select * from geoip_url

Cannot parse input: expected ',' before: 'Asir Region,,Bariq,,18.9297,41.9295,\n2.90.78.0,2.90.78.255,SA,\'Asir Region,,Khamis Mushait,,18.3,42.7333,\n2.90.79.0,2.90.80.0,SA,Mecca Region,,Jeddah,,21.4901,3': Row 18921: Column 0, name: ip_range_start, type: ipv4, parsed text: "2.90.75.0" Column 1, name: ip_range_end, type: ipv4, parsed text: "2.90.75.255" Column 2, name: country_code, type: nullable(string), parsed text: "SA" Column 3, name: state1, type: nullable(string), parsed text: "Ha<SINGLE QUOTE>il Region" Column 4, name: state2, type: nullable(string), parsed text: <EMPTY> Column 5, name: city, type: nullable(string), parsed text: "Ha<SINGLE QUOTE>il" Column 6, name: postcode, type: nullable(string), parsed text: <EMPTY> Column 7, name: latitude, type: float64, parsed text: "27.5219" Column 8, name: longitude, type: float64, parsed text: "41.6907" Column 9, name: timezone, type: nullable(string), parsed text: <EMPTY> Row 18922: Column 0, name: ip_range_start, type: ipv4, parsed text: "2.90.76.0" Column 1, name: ip_range_end, type: ipv4, parsed text: "2.90.76.255" Column 2, name: country_code, type: nullable(string), parsed text: "SA" Column 3, name: state1, type: nullable(string), parsed text: "<SINGLE QUOTE>Asir Region,,Khamis Mushait,,18.3,42.7333,<LINE FEED>2.90.77.0,2.90.77.255,SA,<SINGLE QUOTE>" ERROR: There is no delimiter (,). "A" found instead. : While executing CSVRowInputFormat: While executing URL: (in file/uri https://raw.githubusercontent.com/sapics/ip-location-db/master/dbip-city/dbip-city-ipv4.csv.gz): (at row 18922)

is it because the URL table engine is actually not supported?

[lizhou1111]

maybe it is related to #376