Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

使用lgraph_import导入数据失败 #242

Closed
Li-Rong-Gang opened this issue Jun 29, 2023 · 3 comments
Closed

使用lgraph_import导入数据失败 #242

Li-Rong-Gang opened this issue Jun 29, 2023 · 3 comments

Comments

@Li-Rong-Gang
Copy link

Li-Rong-Gang commented Jun 29, 2023

lgraph_import: /usr/local/aegis/PythonLoader/third_party/libcrypto.so.1.0.0: no version information available (required by lgraph_import)
lgraph_import: /usr/local/aegis/PythonLoader/third_party/libssl.so.1.0.0: no version information available (required by lgraph_import)
lgraph_import: /usr/local/aegis/PythonLoader/third_party/libcrypto.so.1.0.0: no version information available (required by /usr/local/lib64/liblgraph.so)
20230629155517.700: Importing FROM SCRATCH:
20230629155517.700: 	from:                import.conf
20230629155517.700: 	to:                  /data/attachments/data/lgraph_db
20230629155517.700: 	verbose:             1
20230629155517.700: 	log:
20230629155517.772: Graph already exists, all the data in the graph will be overwritten.
20230629155517.912: Total file size: 1.46934GB
20230629155517.913: Load vertex label Comment
20230629155517.991: 	File [comment.csv]
20230629155518.431: An error occurred during import:
20230629155518.431:   Failed to parse file [comment.csv]
20230629155518.431:     Error parsing file comment.csv
20230629155518.431: 	Error occurred at offset 0, exception detail:
20230629155518.431: 	Missing delimiter after column 1
20230629155518.431: >Error line:
20230629155518.431: 	1236950581249,2011-08-17T14:26:59.961+0000,92.39.58.88,Chrome,yes,3
20230629155518.431: >Binary format:
20230629155518.431: 	49(1) 50(2) 51(3) 54(6) 57(9) 53(5) 48(0) 53(5) 56(8) 49(1) 50(2) 52(4) 57(9) 44(,) 50(2) 48(0) 49(1) 49(1) 45(-) 48(0) 56(8) 45(-) 49(1) 55(7) 84(T) 49(1) 52(4) 58(:) 50(2) 54(6) 58(:) 53(5) 57(9) 46(.) 57(9) 54(6) 49(1) 43(+) 48(0) 48(0) 48(0) 48(0) 44(,) 57(9) 50(2) 46(.) 51(3) 57(9) 46(.) 53(5) 56(8) 46(.) 56(8) 56(8) 44(,) 67(C) 104(h) 114(r) 111(o) 109(m) 101(e) 44(,) 121(y) 101(e) 115(s) 44(,) 51(3)

在LDBC官网下载了Tugraph3.2.0做LDBC测试的包,按照提供的手册对ldbc_hadoop_datagen生成的数据集转换输出到import_data文件夹,在将转换后的数据用lgraph_import导入时报错,提示"Missing delimiter after column 1",是convert的过程出了什么问题吗?还是模式没有匹配到?LDBC生成数据选择的参数文件都试过了,都得到了同样的报错。

@Li-Rong-Gang
Copy link
Author

1236950581249,2011-08-17T14:26:59.961+0000,92.39.58.88,Chrome,yes,3,10995116284808,86,1236950581248,
1236950581250,2011-08-17T11:10:21.570+0000,213.55.127.9,Internet Explorer,thanks,6,4139,76,1236950581248,
2061584302085,2012-07-20T05:22:51.283+0000,213.55.127.9,Internet Explorer,LOL,3,4139,76,2061584302084,
2061584302086,2012-07-20T16:55:45.373+0000,213.55.127.9,Internet Explorer,I see,5,4139,76,2061584302084,
2061584302087,2012-07-20T04:34:17.500+0000,213.55.127.9,Internet Explorer,fine,4,4139,76,2061584302084,
2061584302088,2012-07-20T17:35:11.096+0000,92.39.58.88,Chrome,right,5,10995116284808,86,2061584302084,

这是import_data文件夹中comment.csv前几行的数据

@lipanpan03
Copy link
Collaborator

看上去是转换过程出现了问题,利用hadoop生成数据之后要执行convert_csvs.sh脚本将数据转换成正确的格式,comment.csv的数据样例如下所示:
19791209299969,1313591219961,31.47.75.9,Internet Explorer,yes,3,52694,99,19791209299968,
convert_csvs.sh执行成功的话date列会转成时间戳格式

@qishipengqsp
Copy link
Collaborator

The issue is closed due to inactivity. Please feel free to create a new one if you have more questions. And please star this repo if you find it useful! Thanks!
此issue由于长期不活跃被关闭。如有任何问题,可另开 issue 并提供更多信息。如果这个项目帮助到你,可以在仓库右上角 star 一下,感谢你的支持!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants