应用举例¶
CSV文件导入到神通数据库(OSCAR)¶
短参数: datamigrate -y TEXTFILE -c "," -r "\n" -e "\"" -f "/opt/file01.csv" -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST
长参数: datamigrate stype=TEXTFILE sfcolsplit="," sfrowsplit="\n" sfescape ="\"" sflist="/opt/file01.csv" dtype=OSCAR ddburl= username/password@localhost:2003/OSRDB ddbtab=TEST
CSV目录导入到神通数据库(OSCAR)¶
将filedir文件夹下的所有.csv文件都要导入到数据库的TEST表中:
短参数: datamigrate -y TEXTDIR -c "," -r "\n" -e "\"" -f "/opt/filedir" -j ".csv" -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST
-y TEXTDIR:源端为文本目录
-f "/data/filedir":文件夹filedir的绝对路径
-j ".csv":文件后缀为".csv"
长参数: datamigrate stype=TEXTFILE sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/opt/file01.csv" dtype=KSTORE ddburl= username/password@localhost:2003/KSTORE ddbtab=TEST
CSV文件导入到KSTORE或MPP5¶
短参数: datamigrate -y TEXTFILE -c "," -r "\n" -e "\"" -f "/opt/file01.csv" -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST
长参数: datamigrate stype=TEXTFILE sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/opt/file01.csv" dtype=KSTORE ddburl= username/password@localhost:2003/KSTORE ddbtab=TEST
CSV目录导入到KSTORE或MPP5¶
将filedir文件夹下的所有.csv文件都要导入到数据库的TEST表中:
短参数: datamigrate -y TEXTDIR -c "," -r "\n" -e "\"" -f "/opt/filedir" -j ".csv" -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST
-y TEXTDIR:源端为文本目录
-f "/data/filedir":文件夹filedir的绝对路径
-j ".csv":文件后缀为".csv"
长参数: datamigrate stype= TEXTDIR sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/opt/filedir" sfsuffix=".csv" dtype=KSTORE ddburl= username/password@localhost:2003/KSTORE ddbtab=TEST
CSV文件导入到xCluster¶
短参数: datamigrate -y TEXTFILE -c "," -r "\n" -e "\"" -f "/ opt/file01.csv" -Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST
长参数: datamigrate stype=TEXTFILE sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/opt/file01.csv" dtype=XCLUSTER ddburl= username/password@localhost:2010/BXDB ddbtab=TEST
CSV目录导入到xCluster¶
将filedir文件夹下的所有.csv文件都要导入到集群的TEST表中: 短参数: datamigrate -y TEXTDIR -c "," -r "\n" -e "\"" -f "/opt/filedir" -j ".csv" -Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST -y TEXTDIR:源端为文本目录 -f "/data/filedir":文件夹filedir的绝对路径 -j ".csv":文件后缀为".csv"
长参数: datamigrate stype= TEXTDIR sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/opt/filedir" sfsuffix=".csv" dtype=XCLUSTER ddburl= username/password@localhost: 2010/BXDB ddbtab=TEST
SQL文件导入到神通数据库(OSCAR)¶
短参数: datamigrate -y SQLFILE -f "/data1/file01.sql" -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST
长参数: datamigrate stype= SQLFILE sflist="/opt/file01.sql" dtype=OSCAR ddburl= username/password@localhost:2003/OSRDB ddbtab=TEST
SQL文件导入到KSTORE或MPP5¶
短参数: datamigrate -y SQLFILE -f "/data1/file01.sql" -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST
长参数: datamigrate stype= SQLFILE sflist="/opt/file01.sql" dtype=KSTORE ddburl= username/password@localhost:2003/KSTORE ddbtab=TEST
SQL文件导入到xCluster¶
短参数: datamigrate -y SQLFILE -f "/data1/file01.sql" –Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST
长参数: datamigrate stype= SQLFILE sflist="/opt/file01.sql" dtype= XCLUSTER ddburl= username/password@localhost:2010/BXDB ddbtab=TEST
XML文件导入到神通数据库(OSCAR)¶
短参数: datamigrate -y XMLFILE -e "rows" -r "row" -f "/opt/file01.xml" -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST
长参数: datamigrate stype= XMLFILE sflist="/opt/ file01.xml" dtype=OSCAR ddburl= username/password@localhost:2003/OSRDB ddbtab=TEST
XML目录导入到神通数据库(OSCAR)¶
短参数: datamigrate -y XMLDIR -e "rows" -r "row" -f "/opt/filedir" -j ".xml" -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST
长参数: datamigrate stype=XMLDIR sflist="/opt/filedir" sfsuffix=".xml" dtype=OSCAR ddburl= username/password@localhost:2003/OSRDB ddbtab=TEST
XML文件导入到神通数据库(xCluster)¶
短参数: datamigrate -y XMLFILE -e "rows" -r "row" -f "/data1/file01.xml" -Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST
长参数: datamigrate stype= XMLFILE sflist="/opt/ file01.xml" dtype= XCLUSTER ddburl=username/password@localhost:2010/BXDB ddbtab=TEST
Oracle到神通数据库(OSCAR)¶
短参数: datamigrate -y ORACLE -u username/password@localhost:1521/orcl -t SYS.TEST -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST
如果使用-m true参数能够使数据的编码方式从Oracle服务器端转换到客户端,客户端的编码方式由参数NLS_LANG决定。
长参数: datamigrate stype=ORACLE sdburl=username/password@localhost:1521/orcl sdbtab=TEST dtype=OSCAR ddburl=username/password@localhost:2003/OSRDB ddbtab=TEST
Oracle到KSTORE或MPP5¶
短参数: datamigrate -y ORACLE -u username/password@localhost:1521/orcl -t SYS.TEST -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST
如果使用-m true参数能够使数据的编码方式从Oracle服务器端转换到客户端,客户端的编码方式由参数NLS_LANG决定。
长参数: datamigrate stype=ORACLE sdburl=username/password@localhost:1521/orcl sdbtab=TEST dtype=KSTORE ddburl=username/password@localhost:2003/KSTORE ddbtab=TEST
Oracle到xCluster¶
短参数: datamigrate -y ORACLE -u username/password@localhost:1521/orcl -t SYS.TEST -Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST
如果使用-m true参数能够使数据的编码方式从Oracle服务器端转换到客户端,客户端的编码方式由参数NLS_LANG决定。
长参数: datamigrate stype=ORACLE sdburl=username/password@localhost:1521/orcl sdbtab=TEST dtype=XCLUSTER ddburl=username/password@localhost:2010/BXDB ddbtab=TEST
Oracle SQL查询结果到神通数据库(OSCAR)¶
短参数: datamigrate -y ORACLE -u username/password@localhost:1521/orcl -q "select * from test where year>2010" -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST
如果使用-m true参数能够使数据的编码方式从Oracle服务器端转换到客户端,客户端的编码方式由参数NLS_LANG决定
长参数: datamigrate stype=ORACLE sdburl=username/password@localhost:1521/orcl sdbsql="select * from test where year>2010" dtype=OSCAR ddburl=username/password@localhost:2003/OSRDB ddbtab=TEST
Oracle SQL查询结果到KSTORE或MPP5¶
短参数: datamigrate -y ORACLE -u username/password@localhost:1521/orcl -q "select * from test where year>2010" -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST
如果使用-m true参数能够使数据的编码方式从Oracle服务器端转换到客户端,客户端的编码方式由参数NLS_LANG决定。
长参数: datamigrate stype=ORACLE sdburl=username/password@localhost:1521/orcl sdbsql="select * from test where year>2010" dtype=KSTORE ddburl=username/password@localhost:2003/KSTORE ddbtab=TEST
Oracle SQL查询结果到xCluster¶
短参数: datamigrate -y ORACLE -u username/password@localhost:1521/orcl -q "select * from test where year>2010" –Y XCLUSTER -U username/password@localhost:2010/ BXDB -T TEST
如果使用-m true参数能够使数据的编码方式从Oracle服务器端转换到客户端,客户端的编码方式由参数NLS_LANG决定。
长参数: datamigrate stype=ORACLE sdburl=username/password@localhost:1521/orcl sdbsql="select * from test where year>2010" dtype=XCLUSTER ddburl=username/password@localhost:2010/BXDB ddbtab=TEST
Mysql到神通数据库(OSCAR)¶
短参数: datamigrate -y MYSQL -u username/password@localhost:3306/mysql -t MYSQL.TEST -m true -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST
-m true : 让数据的编码方式自动转换为客户端的编码方式
长参数: datamigrate stype=MYSQL sdburl=username/password@localhost:3306/mysql sdbtab=TEST sdbconv=true dtype=OSCAR ddburl=username/password@localhost:2003/OSRDB ddbtab=TEST
Mysql到KSTORE或MPP5¶
短参数: datamigrate -y MYSQL -u username/password@localhost:3306/mysql -t MYSQL.TEST -m true -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST
-m true : 让数据的编码方式自动转换为客户端的编码方式
长参数: datamigrate stype=MYSQL sdburl=username/password@localhost:3306/mysql sdbtab=TEST sdbconv=true dtype=KSTORE ddburl=username/password@localhost:2003/KSTORE ddbtab=TEST
Mysql到xCluster¶
短参数: datamigrate -y MYSQL -u username/password@localhost:3306/mysql -t MYSQL.TEST -m true -Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST
-m true : 让数据的编码方式自动转换为客户端的编码方式
长参数: datamigrate stype=MYSQL sdburl=username/password@localhost:3306/mysql sdbtab=TEST sdbconv=true dtype= XCLUSTER ddburl=username/password@localhost:2010/BXDB ddbtab=TEST
Mysql SQL查询结果到神通数据库(OSCAR)¶
短参数: datamigrate -y MYSQL -u username/password@localhost:3306/mysql -q "select * from test where year>2010" -m true -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST
-m true : 让数据的编码方式自动转换为客户端的编码方式
长参数: datamigrate stype=MYSQL sdburl=username/password@localhost:3306/mysql sdbsql="select * from test where year>2010" sdbconv=true dtype=OSCAR ddburl=username/password@localhost:2003/OSRDB ddbtab=TEST
Mysql SQL查询结果到KSTORE或MPP5¶
短参数: datamigrate -y MYSQL -u username/password@localhost:3306/mysql -q "select * from test where year>2010" -m true -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST
-m true : 让数据的编码方式自动转换为客户端的编码方式
长参数: datamigrate stype=MYSQL sdburl=username/password@localhost:3306/mysql sdbsql="select * from test where year>2010" sdbconv=true dtype=KSTORE ddburl=username/password@localhost:2003/KSTORE ddbtab=TEST
Mysql SQL查询结果到xCluster¶
datamigrate -y MYSQL -u username/password@localhost:3306/mysql -q "select * from test where year>2010" -m true -Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST
-m true : 让数据的编码方式自动转换为客户端的编码方式
长参数: datamigrate stype=MYSQL sdburl=username/password@localhost:3306/mysql sdbsql="select * from test where year>2010" sdbconv=true dtype=XCLUSTER ddburl=username/password@localhost:2010/BXDB E ddbtab=TEST
神通数据库(oscar)导出到CSV¶
短参数: datamigrate -y OSCAR -u username/password@localhost:2003/OSRDB -t SYSDBA.TEST -Y TEXTFILE -F "/data/test01.csv,/data/test02.csv" -C "," -R "\n" -E "\""
-F "/data/test01.csv,/data/test02.csv":目的端为两个.csv文件
-C ",":指定列分割符为逗号,由csv文件决定
-R "\n":指定行分割符为"\n", 由csv文件决定
-E "\"":指定转义字符双引号, 由csv文件决定
长参数: datamigrate stype=OSCAR sdburl=username/password@localhost:2003/OSRDB sdbtab=TEST dtype=TEXTFILE sflist="/data/test01.csv,/data/test02.csv" sfcolsplit="," sfrowsplit="\n" sfescape="\""
神通数据库(oscar)SQL查询结果导出到CSV¶
短参数: datamigrate -y OSCAR -u username/password@localhost:2003/OSRDB -q "select * from test where year>2010" -Y TEXTFILE -F "/data/test01.csv " -C "," -R "\n" -E "\""
-F "/data/test01.csv ":目的端为.csv文件
-C ",":指定列分割符为逗号,由csv文件决定
-R "\n":指定行分割符为"n", 由csv文件决定
-E "\"":指定转义字符双引号, 由csv文件决定
长参数: datamigrate stype=OSCAR sdburl=username/password@localhost:2003/OSRDB sdbsql="select * from test where year>2010" dtype=TEXTFILE sflist="/data/test01.csv " sfcolsplit="," sfrowsplit="\n" sfescape="\""
KSTORE或MPP5导出到CSV¶
短参数: datamigrate -y KSTORE -u username/password@ localhost:2003/KSTORE -t SYSDBA.TEST -Y TEXTFILE -F "/data/test01.csv,/data/test02.csv" -C "," -R "\n" -E "\""
-F "/data/test01.csv,/data/test02.csv":目的端为两个.csv文件
-C ",":指定列分割符为逗号,由csv文件决定
-R "\n":指定行分割符为"n", 由csv文件决定
-E "\"":指定转义字符双引号, 由csv文件决定
长参数: datamigrate stype=KSTORE sdburl=username/password@localhost:2003/KSTORE sdbtab=TEST dtype=TEXTFILE sflist="/data/test01.csv,/data/test02.csv" sfcolsplit="," sfrowsplit="\n" sfescape="\""
KSTORE或MPP5 SQL查询结果导出到CSV¶
短参数: datamigrate -y KSTORE -u username/password@localhost:2003/KSTORE -q "select * from test where year>2010" -Y TEXTFILE -F "/data/test01.csv " -C "," -R "\n" -E "\""
-F "/data/test01.csv ":目的端为.csv文件
-C ",":指定列分割符为逗号,由csv文件决定
-R "\n":指定行分割符为"\n", 由csv文件决定
-E "\"":指定转义字符双引号, 由csv文件决定
长参数: datamigrate stype=KSTORE sdburl=username/password@localhost:2003/KSTORE sdbsql="select * from test where year>2010" dtype=TEXTFILE sflist="/data/test01.csv " sfcolsplit="," sfrowsplit="\n" sfescape="\""
xCluster导出到CSV¶
短参数: datamigrate -y XCLUSTER -u username/password@ localhost:2010/BXDB -t SYSDBA.TEST -Y TEXTFILE -F "/data/test01.csv,/data/test02.csv" -C "," -R "\n" -E "\""
-F "/data/test01.csv,/data/test02.csv":目的端为两个.csv文件
-C ",":指定列分割符为逗号,由csv文件决定
-R "\n":指定行分割符为"\n", 由csv文件决定
-E "\"":指定转义字符双引号, 由csv文件决定
长参数: datamigrate stype=XCLUSTER sdburl=username/password@localhost:2010/BXDB sdbtab=TEST dtype=TEXTFILE sflist="/data/test01.csv,/data/test02.csv" sfcolsplit="," sfrowsplit="\n" sfescape="\""
xCluster查询结果导出到CSV¶
短参数: datamigrate -y XCLUSTER -u username/password@localhost:2010/BXDB -q "select * from test where year>2010" -Y TEXTFILE -F "/data/test01.csv " -C "," -R "\n" -E "\""
-F "/data/test01.csv ":目的端为.csv文件
-C ",":指定列分割符为逗号,由csv文件决定
-R "\n":指定行分割符为"\n", 由csv文件决定
-E "\"":指定转义字符双引号, 由csv文件决定
长参数: datamigrate stype=XCLUSTER sdburl=username/password@localhost:2010/BXDB sdbsql="select * from test where year>2010" dtype=TEXTFILE sflist="/data/test01.csv " sfcolsplit="," sfrowsplit="\n" sfescape="\""
HDFS获取文件导入到神通数据库(OSCAR)¶
短参数: datamigrate -y HDFS -u username/password@localhost:9870/curl -c "," -r "\n" -e "\"" -f "/test.csv" -Y OSCAR -U sysdba/szoscar55@localhost:2003/OSRDB -T TEST
例:地址“http://192.168.1.1:9870/webhdfs/v1/test01.csv”
-f "/test01.csv ":源端为HDFS获取.csv文件
-c ",":指定列分割符为逗号,由csv文件决定
-r "\n":指定行分割符为"\n", 由csv文件决定
-e "\"":指定转义字符双引号, 由csv文件决定
长参数: datamigrate stype=HDFS sdburl=username/password@localhost:9870/curl sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/test.csv" dtype=OSCAR ddburl=sysdba/szoscar55@localhost:2003/OSRDB ddbtab=TEST
HTTP获取文件导入到神通数据库(OSCAR)¶
短参数: datamigrate -y HTTP -u username/password@localhost:80/curl -c "," -r "\n" -e "\"" -f "/data/test01.csv" -Y OSCAR -U sysdba/szoscar55@localhost:2003/OSRDB -T TEST
例:网页地址“http://192.168.1.1:80/data/test01.csv”
-f "/data/test01.csv ":源端为HTTP获取.csv文件
-c ",":指定列分割符为逗号,由csv文件决定
-r "\n":指定行分割符为"\n", 由csv文件决定
-e "\"":指定转义字符双引号, 由csv文件决定
长参数: datamigrate stype=HTTP sdburl=username/password@localhost:80/curl sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/data/test01.csv" dtype=OSCAR ddburl=sysdba/szoscar55@localhost:2003/OSRDB ddbtab=TEST
SFTP获取文件导入到神通数据库(OSCAR)¶
短参数: datamigrate -y SFTP -u username/password@localhost:22/curl -c "," -r "\n" -e "\"" -f "/test.csv" -Y OSCAR -U sysdba/szoscar55@localhost:2003/OSRDB -T TEST
-f "/test01.csv ":源端为SFTP获取.csv文件
-c ",":指定列分割符为逗号,由csv文件决定
-r "\n":指定行分割符为"\n", 由csv文件决定
-e "\"":指定转义字符双引号, 由csv文件决定
长参数: datamigrate stype=SFTP sdburl=username/password@localhost:22/curl sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/test.csv" dtype=OSCAR ddburl=sysdba/szoscar55@localhost:2003/OSRDB ddbtab=TEST
FTP获取文件导入到神通数据库(OSCAR)¶
短参数: datamigrate -y FTP -u username/password@localhost:21/curl -c "," -r "\n" -e "\"" -f "/test.csv" -Y OSCAR -U sysdba/szoscar55@localhost:2003/OSRDB -T TEST
-f "/test01.csv ":源端为FTP获取.csv文件
-c ",":指定列分割符为逗号,由csv文件决定
-r "\n":指定行分割符为"\n", 由csv文件决定
-e "\"":指定转义字符双引号, 由csv文件决定
长参数: datamigrate stype=FTP sdburl=username/password@localhost:21/curl sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/test.csv" dtype=OSCAR ddburl=sysdba/szoscar55@localhost:2003/OSRDB ddbtab=TEST