应用举例

CSV文件导入到神通数据库(OSCAR)

短参数: datamigrate -y TEXTFILE -c "," -r "\n" -e "\"" -f "/opt/file01.csv" -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST

长参数: datamigrate stype=TEXTFILE sfcolsplit="," sfrowsplit="\n" sfescape ="\"" sflist="/opt/file01.csv" dtype=OSCAR ddburl= username/password@localhost:2003/OSRDB ddbtab=TEST

CSV目录导入到神通数据库(OSCAR)

将filedir文件夹下的所有.csv文件都要导入到数据库的TEST表中:

短参数: datamigrate -y TEXTDIR -c "," -r "\n" -e "\"" -f "/opt/filedir" -j ".csv" -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST

-y TEXTDIR:源端为文本目录

-f "/data/filedir":文件夹filedir的绝对路径

-j ".csv":文件后缀为".csv"

长参数: datamigrate stype=TEXTFILE sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/opt/file01.csv" dtype=KSTORE ddburl= username/password@localhost:2003/KSTORE ddbtab=TEST

CSV文件导入到KSTORE或MPP5

短参数: datamigrate -y TEXTFILE -c "," -r "\n" -e "\"" -f "/opt/file01.csv" -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST

长参数: datamigrate stype=TEXTFILE sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/opt/file01.csv" dtype=KSTORE ddburl= username/password@localhost:2003/KSTORE ddbtab=TEST

CSV目录导入到KSTORE或MPP5

将filedir文件夹下的所有.csv文件都要导入到数据库的TEST表中:

短参数: datamigrate -y TEXTDIR -c "," -r "\n" -e "\"" -f "/opt/filedir" -j ".csv" -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST

-y TEXTDIR:源端为文本目录

-f "/data/filedir":文件夹filedir的绝对路径

-j ".csv":文件后缀为".csv"

长参数: datamigrate stype= TEXTDIR sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/opt/filedir" sfsuffix=".csv" dtype=KSTORE ddburl= username/password@localhost:2003/KSTORE ddbtab=TEST

CSV文件导入到xCluster

短参数: datamigrate -y TEXTFILE -c "," -r "\n" -e "\"" -f "/ opt/file01.csv" -Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST

长参数: datamigrate stype=TEXTFILE sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/opt/file01.csv" dtype=XCLUSTER ddburl= username/password@localhost:2010/BXDB ddbtab=TEST

CSV目录导入到xCluster

将filedir文件夹下的所有.csv文件都要导入到集群的TEST表中: 短参数: datamigrate -y TEXTDIR -c "," -r "\n" -e "\"" -f "/opt/filedir" -j ".csv" -Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST -y TEXTDIR:源端为文本目录 -f "/data/filedir":文件夹filedir的绝对路径 -j ".csv":文件后缀为".csv"

长参数: datamigrate stype= TEXTDIR sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/opt/filedir" sfsuffix=".csv" dtype=XCLUSTER ddburl= username/password@localhost: 2010/BXDB ddbtab=TEST

SQL文件导入到神通数据库(OSCAR)

短参数: datamigrate -y SQLFILE -f "/data1/file01.sql" -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST

长参数: datamigrate stype= SQLFILE sflist="/opt/file01.sql" dtype=OSCAR ddburl= username/password@localhost:2003/OSRDB ddbtab=TEST

SQL文件导入到KSTORE或MPP5

短参数: datamigrate -y SQLFILE -f "/data1/file01.sql" -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST

长参数: datamigrate stype= SQLFILE sflist="/opt/file01.sql" dtype=KSTORE ddburl= username/password@localhost:2003/KSTORE ddbtab=TEST

SQL文件导入到xCluster

短参数: datamigrate -y SQLFILE -f "/data1/file01.sql" –Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST

长参数: datamigrate stype= SQLFILE sflist="/opt/file01.sql" dtype= XCLUSTER ddburl= username/password@localhost:2010/BXDB ddbtab=TEST

XML文件导入到神通数据库(OSCAR)

短参数: datamigrate -y XMLFILE -e "rows" -r "row" -f "/opt/file01.xml" -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST

长参数: datamigrate stype= XMLFILE sflist="/opt/ file01.xml" dtype=OSCAR ddburl= username/password@localhost:2003/OSRDB ddbtab=TEST

XML目录导入到神通数据库(OSCAR)

短参数: datamigrate -y XMLDIR -e "rows" -r "row" -f "/opt/filedir" -j ".xml" -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST

长参数: datamigrate stype=XMLDIR sflist="/opt/filedir" sfsuffix=".xml" dtype=OSCAR ddburl= username/password@localhost:2003/OSRDB ddbtab=TEST

XML文件导入到神通数据库(xCluster)

短参数: datamigrate -y XMLFILE -e "rows" -r "row" -f "/data1/file01.xml" -Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST

长参数: datamigrate stype= XMLFILE sflist="/opt/ file01.xml" dtype= XCLUSTER ddburl=username/password@localhost:2010/BXDB ddbtab=TEST

Oracle到神通数据库(OSCAR)

短参数: datamigrate -y ORACLE -u username/password@localhost:1521/orcl -t SYS.TEST -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST

如果使用-m true参数能够使数据的编码方式从Oracle服务器端转换到客户端,客户端的编码方式由参数NLS_LANG决定。

长参数: datamigrate stype=ORACLE sdburl=username/password@localhost:1521/orcl sdbtab=TEST dtype=OSCAR ddburl=username/password@localhost:2003/OSRDB ddbtab=TEST

Oracle到KSTORE或MPP5

短参数: datamigrate -y ORACLE -u username/password@localhost:1521/orcl -t SYS.TEST -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST

如果使用-m true参数能够使数据的编码方式从Oracle服务器端转换到客户端,客户端的编码方式由参数NLS_LANG决定。

长参数: datamigrate stype=ORACLE sdburl=username/password@localhost:1521/orcl sdbtab=TEST dtype=KSTORE ddburl=username/password@localhost:2003/KSTORE ddbtab=TEST

Oracle到xCluster

短参数: datamigrate -y ORACLE -u username/password@localhost:1521/orcl -t SYS.TEST -Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST

如果使用-m true参数能够使数据的编码方式从Oracle服务器端转换到客户端,客户端的编码方式由参数NLS_LANG决定。

长参数: datamigrate stype=ORACLE sdburl=username/password@localhost:1521/orcl sdbtab=TEST dtype=XCLUSTER ddburl=username/password@localhost:2010/BXDB ddbtab=TEST

Oracle SQL查询结果到神通数据库(OSCAR)

短参数: datamigrate -y ORACLE -u username/password@localhost:1521/orcl -q "select * from test where year>2010" -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST

如果使用-m true参数能够使数据的编码方式从Oracle服务器端转换到客户端,客户端的编码方式由参数NLS_LANG决定

长参数: datamigrate stype=ORACLE sdburl=username/password@localhost:1521/orcl sdbsql="select * from test where year>2010" dtype=OSCAR ddburl=username/password@localhost:2003/OSRDB ddbtab=TEST

Oracle SQL查询结果到KSTORE或MPP5

短参数: datamigrate -y ORACLE -u username/password@localhost:1521/orcl -q "select * from test where year>2010" -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST

如果使用-m true参数能够使数据的编码方式从Oracle服务器端转换到客户端,客户端的编码方式由参数NLS_LANG决定。

长参数: datamigrate stype=ORACLE sdburl=username/password@localhost:1521/orcl sdbsql="select * from test where year>2010" dtype=KSTORE ddburl=username/password@localhost:2003/KSTORE ddbtab=TEST

Oracle SQL查询结果到xCluster

短参数: datamigrate -y ORACLE -u username/password@localhost:1521/orcl -q "select * from test where year>2010" –Y XCLUSTER -U username/password@localhost:2010/ BXDB -T TEST

如果使用-m true参数能够使数据的编码方式从Oracle服务器端转换到客户端,客户端的编码方式由参数NLS_LANG决定。

长参数: datamigrate stype=ORACLE sdburl=username/password@localhost:1521/orcl sdbsql="select * from test where year>2010" dtype=XCLUSTER ddburl=username/password@localhost:2010/BXDB ddbtab=TEST

Mysql到神通数据库(OSCAR)

短参数: datamigrate -y MYSQL -u username/password@localhost:3306/mysql -t MYSQL.TEST -m true -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST

-m true : 让数据的编码方式自动转换为客户端的编码方式

长参数: datamigrate stype=MYSQL sdburl=username/password@localhost:3306/mysql sdbtab=TEST sdbconv=true dtype=OSCAR ddburl=username/password@localhost:2003/OSRDB ddbtab=TEST

Mysql到KSTORE或MPP5

短参数: datamigrate -y MYSQL -u username/password@localhost:3306/mysql -t MYSQL.TEST -m true -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST

-m true : 让数据的编码方式自动转换为客户端的编码方式

长参数: datamigrate stype=MYSQL sdburl=username/password@localhost:3306/mysql sdbtab=TEST sdbconv=true dtype=KSTORE ddburl=username/password@localhost:2003/KSTORE ddbtab=TEST

Mysql到xCluster

短参数: datamigrate -y MYSQL -u username/password@localhost:3306/mysql -t MYSQL.TEST -m true -Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST

-m true : 让数据的编码方式自动转换为客户端的编码方式

长参数: datamigrate stype=MYSQL sdburl=username/password@localhost:3306/mysql sdbtab=TEST sdbconv=true dtype= XCLUSTER ddburl=username/password@localhost:2010/BXDB ddbtab=TEST

Mysql SQL查询结果到神通数据库(OSCAR)

短参数: datamigrate -y MYSQL -u username/password@localhost:3306/mysql -q "select * from test where year>2010" -m true -Y OSCAR -U username/password@localhost:2003/OSRDB -T TEST

-m true : 让数据的编码方式自动转换为客户端的编码方式

长参数: datamigrate stype=MYSQL sdburl=username/password@localhost:3306/mysql sdbsql="select * from test where year>2010" sdbconv=true dtype=OSCAR ddburl=username/password@localhost:2003/OSRDB ddbtab=TEST

Mysql SQL查询结果到KSTORE或MPP5

短参数: datamigrate -y MYSQL -u username/password@localhost:3306/mysql -q "select * from test where year>2010" -m true -Y KSTORE -U username/password@localhost:2003/KSTORE -T TEST

-m true : 让数据的编码方式自动转换为客户端的编码方式

长参数: datamigrate stype=MYSQL sdburl=username/password@localhost:3306/mysql sdbsql="select * from test where year>2010" sdbconv=true dtype=KSTORE ddburl=username/password@localhost:2003/KSTORE ddbtab=TEST

Mysql SQL查询结果到xCluster

datamigrate -y MYSQL -u username/password@localhost:3306/mysql -q "select * from test where year>2010" -m true -Y XCLUSTER -U username/password@localhost:2010/BXDB -T TEST

-m true : 让数据的编码方式自动转换为客户端的编码方式

长参数: datamigrate stype=MYSQL sdburl=username/password@localhost:3306/mysql sdbsql="select * from test where year>2010" sdbconv=true dtype=XCLUSTER ddburl=username/password@localhost:2010/BXDB E ddbtab=TEST

神通数据库(oscar)导出到CSV

短参数: datamigrate -y OSCAR -u username/password@localhost:2003/OSRDB -t SYSDBA.TEST -Y TEXTFILE -F "/data/test01.csv,/data/test02.csv" -C "," -R "\n" -E "\""

-F "/data/test01.csv,/data/test02.csv":目的端为两个.csv文件

-C ",":指定列分割符为逗号,由csv文件决定

-R "\n":指定行分割符为"\n", 由csv文件决定

-E "\"":指定转义字符双引号, 由csv文件决定

长参数: datamigrate stype=OSCAR sdburl=username/password@localhost:2003/OSRDB sdbtab=TEST dtype=TEXTFILE sflist="/data/test01.csv,/data/test02.csv" sfcolsplit="," sfrowsplit="\n" sfescape="\""

神通数据库(oscar)SQL查询结果导出到CSV

短参数: datamigrate -y OSCAR -u username/password@localhost:2003/OSRDB -q "select * from test where year>2010" -Y TEXTFILE -F "/data/test01.csv " -C "," -R "\n" -E "\""

-F "/data/test01.csv ":目的端为.csv文件

-C ",":指定列分割符为逗号,由csv文件决定

-R "\n":指定行分割符为"n", 由csv文件决定

-E "\"":指定转义字符双引号, 由csv文件决定

长参数: datamigrate stype=OSCAR sdburl=username/password@localhost:2003/OSRDB sdbsql="select * from test where year>2010" dtype=TEXTFILE sflist="/data/test01.csv " sfcolsplit="," sfrowsplit="\n" sfescape="\""

KSTORE或MPP5导出到CSV

短参数: datamigrate -y KSTORE -u username/password@ localhost:2003/KSTORE -t SYSDBA.TEST -Y TEXTFILE -F "/data/test01.csv,/data/test02.csv" -C "," -R "\n" -E "\""

-F "/data/test01.csv,/data/test02.csv":目的端为两个.csv文件

-C ",":指定列分割符为逗号,由csv文件决定

-R "\n":指定行分割符为"n", 由csv文件决定

-E "\"":指定转义字符双引号, 由csv文件决定

长参数: datamigrate stype=KSTORE sdburl=username/password@localhost:2003/KSTORE sdbtab=TEST dtype=TEXTFILE sflist="/data/test01.csv,/data/test02.csv" sfcolsplit="," sfrowsplit="\n" sfescape="\""

KSTORE或MPP5 SQL查询结果导出到CSV

短参数: datamigrate -y KSTORE -u username/password@localhost:2003/KSTORE -q "select * from test where year>2010" -Y TEXTFILE -F "/data/test01.csv " -C "," -R "\n" -E "\""

-F "/data/test01.csv ":目的端为.csv文件

-C ",":指定列分割符为逗号,由csv文件决定

-R "\n":指定行分割符为"\n", 由csv文件决定

-E "\"":指定转义字符双引号, 由csv文件决定

长参数: datamigrate stype=KSTORE sdburl=username/password@localhost:2003/KSTORE sdbsql="select * from test where year>2010" dtype=TEXTFILE sflist="/data/test01.csv " sfcolsplit="," sfrowsplit="\n" sfescape="\""

xCluster导出到CSV

短参数: datamigrate -y XCLUSTER -u username/password@ localhost:2010/BXDB -t SYSDBA.TEST -Y TEXTFILE -F "/data/test01.csv,/data/test02.csv" -C "," -R "\n" -E "\""

-F "/data/test01.csv,/data/test02.csv":目的端为两个.csv文件

-C ",":指定列分割符为逗号,由csv文件决定

-R "\n":指定行分割符为"\n", 由csv文件决定

-E "\"":指定转义字符双引号, 由csv文件决定

长参数: datamigrate stype=XCLUSTER sdburl=username/password@localhost:2010/BXDB sdbtab=TEST dtype=TEXTFILE sflist="/data/test01.csv,/data/test02.csv" sfcolsplit="," sfrowsplit="\n" sfescape="\""

xCluster查询结果导出到CSV

短参数: datamigrate -y XCLUSTER -u username/password@localhost:2010/BXDB -q "select * from test where year>2010" -Y TEXTFILE -F "/data/test01.csv " -C "," -R "\n" -E "\""

-F "/data/test01.csv ":目的端为.csv文件

-C ",":指定列分割符为逗号,由csv文件决定

-R "\n":指定行分割符为"\n", 由csv文件决定

-E "\"":指定转义字符双引号, 由csv文件决定

长参数: datamigrate stype=XCLUSTER sdburl=username/password@localhost:2010/BXDB sdbsql="select * from test where year>2010" dtype=TEXTFILE sflist="/data/test01.csv " sfcolsplit="," sfrowsplit="\n" sfescape="\""

HDFS获取文件导入到神通数据库(OSCAR)

短参数: datamigrate -y HDFS -u username/password@localhost:9870/curl -c "," -r "\n" -e "\"" -f "/test.csv" -Y OSCAR -U sysdba/szoscar55@localhost:2003/OSRDB -T TEST

例:地址“http://192.168.1.1:9870/webhdfs/v1/test01.csv

-f "/test01.csv ":源端为HDFS获取.csv文件

-c ",":指定列分割符为逗号,由csv文件决定

-r "\n":指定行分割符为"\n", 由csv文件决定

-e "\"":指定转义字符双引号, 由csv文件决定

长参数: datamigrate stype=HDFS sdburl=username/password@localhost:9870/curl sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/test.csv" dtype=OSCAR ddburl=sysdba/szoscar55@localhost:2003/OSRDB ddbtab=TEST

HTTP获取文件导入到神通数据库(OSCAR)

短参数: datamigrate -y HTTP -u username/password@localhost:80/curl -c "," -r "\n" -e "\"" -f "/data/test01.csv" -Y OSCAR -U sysdba/szoscar55@localhost:2003/OSRDB -T TEST

例:网页地址“http://192.168.1.1:80/data/test01.csv

-f "/data/test01.csv ":源端为HTTP获取.csv文件

-c ",":指定列分割符为逗号,由csv文件决定

-r "\n":指定行分割符为"\n", 由csv文件决定

-e "\"":指定转义字符双引号, 由csv文件决定

长参数: datamigrate stype=HTTP sdburl=username/password@localhost:80/curl sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/data/test01.csv" dtype=OSCAR ddburl=sysdba/szoscar55@localhost:2003/OSRDB ddbtab=TEST

SFTP获取文件导入到神通数据库(OSCAR)

短参数: datamigrate -y SFTP -u username/password@localhost:22/curl -c "," -r "\n" -e "\"" -f "/test.csv" -Y OSCAR -U sysdba/szoscar55@localhost:2003/OSRDB -T TEST

-f "/test01.csv ":源端为SFTP获取.csv文件

-c ",":指定列分割符为逗号,由csv文件决定

-r "\n":指定行分割符为"\n", 由csv文件决定

-e "\"":指定转义字符双引号, 由csv文件决定

长参数: datamigrate stype=SFTP sdburl=username/password@localhost:22/curl sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/test.csv" dtype=OSCAR ddburl=sysdba/szoscar55@localhost:2003/OSRDB ddbtab=TEST

FTP获取文件导入到神通数据库(OSCAR)

短参数: datamigrate -y FTP -u username/password@localhost:21/curl -c "," -r "\n" -e "\"" -f "/test.csv" -Y OSCAR -U sysdba/szoscar55@localhost:2003/OSRDB -T TEST

-f "/test01.csv ":源端为FTP获取.csv文件

-c ",":指定列分割符为逗号,由csv文件决定

-r "\n":指定行分割符为"\n", 由csv文件决定

-e "\"":指定转义字符双引号, 由csv文件决定

长参数: datamigrate stype=FTP sdburl=username/password@localhost:21/curl sfcolsplit="," sfrowsplit="\n" sfescape="\"" sflist="/test.csv" dtype=OSCAR ddburl=sysdba/szoscar55@localhost:2003/OSRDB ddbtab=TEST