2.1.3 版本routine创建包含jsonpath和jsonroot消费报错

💬 StarRocks 用户问答
#1

create routine load routine_xxx on xxx
COLUMNS TERMINATED BY “,”,
COLUMNS(opdate,id,gps,opuser,qrcode,insertdate)
PROPERTIES
(
“format” = “json”,
“json_root” = “$.message”,
“jsonpaths” = “[”$.opdate","$.id","$.gps","$.opuser","$.qrcode","$.insertdate"]",
“desired_concurrent_number”=“1”,
“strict_mode” = “false”,
“strip_outer_array” =“false”,
“max_error_number” = “10000”
)
FROM KAFKA
(
“kafka_broker_list” = “192.168.173.128:9092”,
“kafka_topic” = “xxx”,
“kafka_partitions” = “0”,
“kafka_offsets” = “OFFSET_BEGINNING”
);

如上创建routine后，消费会一直报错，json path and json root 配置无法同时存在，2.0.3版本下测试时正常的。2.1版本下貌似就会报错，这是bug嘛，还是需要修改写法？

[RoutineLoadJob.executeTaskOnTxnStatusChanged():1015] routine load task [job name routine_xxx, task id d4d0de8e-57b6-4de8-9552-19e0056f61aa] aborted because of json path and json root cannot be both set, remove old task and generate new one

#2

你好，2.1需要修改下语法

"jsonpaths" = "["$.message.opdate","$.message.id","$.message.gps","$.message.opuser","$. message.qrcode","$.message.insertdate"]",

另外$.message中的字段个数和名字是和starrocks中的建表字段个数和名字一致吗？一致的话，按照下面配置也可以

create routine load routine_xxx on xxx
COLUMNS TERMINATED BY “,”
PROPERTIES
(
“format” = “json”,
“desired_concurrent_number”=“1”,
“strict_mode” = “false”,
“max_error_number” = “10000”
)
FROM KAFKA
(
“kafka_broker_list” = “192.168.173.128:9092”,
“kafka_topic” = “xxx”,
“kafka_partitions” = “0”,
“kafka_offsets” = “OFFSET_BEGINNING”
);
#3

测试了下，2.1版本下用$.message.opdate的方式替代jsonroot可行，请问下，这种方式是否兼容之前版本和以后的新版本？

#4

是的，后续期望统一用json_path来表达所有的json格式

#5

好的，谢谢…

京ICP备2022026421号-1