我在 Oracle XE 11g 中有一个表

SQL> create table bloblkup (
  2  id NUMBER PRIMARY KEY,
  3  name varchar(28) NOT NULL,
  4  fdata BLOB
  5  );

Table created.

SQL> desc bloblkup
 Name                      Null?    Type
 ----------------------------------------- -------- ----------------------------
 ID                    NOT NULL NUMBER
 NAME                      NOT NULL VARCHAR2(28)
 FDATA                          BLOB

充满了

SQL> select * from bloblkup;

    ID NAME
---------- ----------------------------
FDATA
--------------------------------------------------------------------------------
     1 photo.jpg
032135435135

我尝试从集群中将此表 Sqoop 到 HDFS

sqoop import --connect jdbc:oracle:thin:@Rhea:1521:xe --username SYSTEM --password oracle --table bloblkup --columns 'name' -m 1

每次都执行完成但提供信息

15/03/24 09:14:39 INFO mapreduce.ImportJobBase: Retrieved 0 records.

我可以检索数据库和表格。

我以创建并拥有该表的系统身份登录。

我还发现我可以查询诸如 all_tables 之类的表并返回行，而不是我通过 sqlplus 创建的表>

我在第一次尝试失败后添加了 --m 1 标志，因为无法找到表的主键。我使用 alter table 在表中添加了一个主键，没有任何更改。

想法？

控制台输出:

[root@sandbox ~]# sqoop import --connect jdbc:oracle:thin:@Rhea:1521:xe --username SYSTEM --password oracle --table bloblkup --columns 'name' -m 1
Warning: /usr/lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
15/03/24 09:14:02 INFO sqoop.Sqoop: Running Sqoop version: 1.4.4.2.1.1.0-385
15/03/24 09:14:02 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
15/03/24 09:14:02 INFO manager.SqlManager: Using default fetchSize of 1000
15/03/24 09:14:02 INFO tool.CodeGenTool: Beginning code generation
15/03/24 09:14:04 INFO manager.OracleManager: Time zone has been set to GMT
15/03/24 09:14:05 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM bloblkup t WHERE 1=0
15/03/24 09:14:05 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/lib/hadoop-mapreduce
Note: /tmp/sqoop-root/compile/ce267f99c7e1b14da474c2c395368b67/bloblkup.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
15/03/24 09:14:08 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/ce267f99c7e1b14da474c2c395368b67/bloblkup.jar
15/03/24 09:14:08 INFO manager.OracleManager: Time zone has been set to GMT
15/03/24 09:14:08 INFO mapreduce.ImportJobBase: Beginning import of bloblkup
15/03/24 09:14:09 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
15/03/24 09:14:10 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
15/03/24 09:14:10 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/192.168.1.91:8050
15/03/24 09:14:12 INFO db.DBInputFormat: Using read commited transaction isolation
15/03/24 09:14:13 INFO mapreduce.JobSubmitter: number of splits:1
15/03/24 09:14:13 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1427151026592_0037
15/03/24 09:14:14 INFO impl.YarnClientImpl: Submitted application application_1427151026592_0037
15/03/24 09:14:14 INFO mapreduce.Job: The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1427151026592_0037/
15/03/24 09:14:14 INFO mapreduce.Job: Running job: job_1427151026592_0037
15/03/24 09:14:27 INFO mapreduce.Job: Job job_1427151026592_0037 running in uber mode : false
15/03/24 09:14:27 INFO mapreduce.Job:  map 0% reduce 0%
15/03/24 09:14:38 INFO mapreduce.Job:  map 100% reduce 0%
15/03/24 09:14:39 INFO mapreduce.Job: Job job_1427151026592_0037 completed successfully
15/03/24 09:14:39 INFO mapreduce.Job: Counters: 30
    File System Counters
        FILE: Number of bytes read=0
        FILE: Number of bytes written=107031
        FILE: Number of read operations=0
        FILE: Number of large read operations=0
        FILE: Number of write operations=0
        HDFS: Number of bytes read=87
        HDFS: Number of bytes written=0
        HDFS: Number of read operations=4
        HDFS: Number of large read operations=0
        HDFS: Number of write operations=2
    Job Counters
        Launched map tasks=1
        Other local map tasks=1
        Total time spent by all maps in occupied slots (ms)=8553
        Total time spent by all reduces in occupied slots (ms)=0
        Total time spent by all map tasks (ms)=8553
        Total vcore-seconds taken by all map tasks=8553
        Total megabyte-seconds taken by all map tasks=2138250
    Map-Reduce Framework
        Map input records=0
        Map output records=0
        Input split bytes=87
        Spilled Records=0
        Failed Shuffles=0
        Merged Map outputs=0
        GC time elapsed (ms)=76
        CPU time spent (ms)=2170
        Physical memory (bytes) snapshot=145907712
        Virtual memory (bytes) snapshot=897458176
        Total committed heap usage (bytes)=75497472
    File Input Format Counters
        Bytes Read=0
    File Output Format Counters
        Bytes Written=0
15/03/24 09:14:39 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 28.8478 seconds (0 bytes/sec)
15/03/24 09:14:39 INFO mapreduce.ImportJobBase: Retrieved 0 records.

最佳答案

更新 Oracle 驱动程序版本 ojdbc6.jar 似乎可以工作，但在使用 ojdbc7.jar 的 JDK 1.7 中会出现问题

此外，您必须在 SQLPLUS 中“提交”数据库更改以使其持久化

关于hadoop - Oracle Sqoop 检索到 0 条记录，我们在Stack Overflow上找到一个类似的问题： https://stackoverflow.com/questions/29224296/