Академический Документы
Профессиональный Документы
Культура Документы
SQL LOADER is an Oracle utility used to load data into table given a datafile which has the
records that need to be loaded. SQL*Loader takes data file, as well as a control file, to insert
data into the table. When a Control file is executed, it can create Three (3) files called log
file, bad file or reject file, discard file.
Log file tells you the state of the tables and indexes and the number of logical records
already read from the input datafile. This information can be used to resume the load
where it left off.
Bad file or reject file gives you the records that were rejected because of formatting errors
or because they caused Oracle errors.
Discard file specifies the records that do not meet any of the loading criteria like when any
of the WHEN clauses specified in the control file. These records differ from rejected records.
Structure of the data file:
The data file can be in fixed record format or variable record format.
Fixed Record Format would look like the below. In this case you give a specific position
where the Control file can expect a data field:
7369 SMITH
CLERK
7902 12/17/1980
7499 ALLEN
1600
7521 WARD
1250
7566 JONES
2975
800
1250
7698 BLAKE
2850
7782 CLARK
2450
7788 SCOTT
7839 KING
PRESIDENT
11/17/1981
3000
5000
1500
7876 ADAMS
CLERK
7788 1/12/1983
1100
7900 JAMES
CLERK
7698 12/3/1981
950
7902 FORD
ANALYST
7566 12/3/1981
3000
7934 MILLER
CLERK
7782 1/23/1982
1300
Variable Record Format would like below where the data fields are separated by a delimiter.
Note: The Delimiter can be anything you like. In this case it is |
1196700|9|0|692.64
1378901|2|3900|488.62
1418700|2|2320|467.92
1418702|14|8740|4056.36
1499100|1|0|3.68
1632800|3|0|1866.66
1632900|1|70|12.64
1637600|50|0|755.5
Structure of a Control file:
Sample CTL file for loading a Variable record data file:
OPTIONS (SKIP = 1)
without loading
LOAD DATA
INFILE '$FILE'
APPEND
REPLACE, TRUNCATE
TRAILING NULLCOLS
treated as null
(ITEM_NUMBER
on columns
QTY
DECIMAL EXTERNAL,
REVENUE
DECIMAL EXTERNAL,
EXT_COST
DECIMAL EXTERNAL TERMINATED BY WHITESPACE
"(TRIM(:EXT_COST))" ,
MONTH
YY')" ,
"to_char(LAST_DAY(ADD_MONTHS(SYSDATE,-1)),'DD-MON-
DIVISION_CODE
CONSTANT "AUD" -- Can specify constant value
instead of Getting value from datafile
)
OPTION statement precedes the LOAD DATA statement. The OPTIONS parameter allows
you to specify runtime arguments in the control file, rather than on the command line. The
following arguments can be specified using the OPTIONS parameter.
SKIP = n Number of logical records to skip (Default 0)
LOAD = n Number of logical records to load (Default all)
ERRORS = n Number of errors to allow (Default 50)
ROWS = n Number of rows in conventional path bind array or between direct path data
saves (Default: Conventional Path 64, Direct path all)
BINDSIZE = n Size of conventional path bind array in bytes (System-dependent default)
SILENT = {FEEDBACK | ERRORS | DISCARDS | ALL} Suppress messages during run
(header, feedback, errors, discards, partitions, all)
DIRECT = {TRUE | FALSE} Use direct path (Default FALSE)
PARALLEL = {TRUE | FALSE} Perform parallel load (Default FALSE)
FIELDS TERMINATED BY ,
( emp_num, emp_name, department_num, department_name )
TYPE OF LOADING:
INSERT If the table you are loading is empty, INSERT can be used.
APPEND If data already exists in the table, SQL*Loader appends the new rows to it. If
data doesnt already exist, the new rows are simply loaded.
REPLACE All rows in the table are deleted and the new data is loaded
TRUNCATE SQL*Loader uses the SQL TRUNCATE command.
INTO TABLE is required to identify the table to be loaded into. In the above example INTO
TABLE APPS.BUDGET, APPS refers to the Schema and BUDGET is the Table name.
FIELDS TERMINATED BY specifies how the data fields are terminated in the datafile.(If the
file is Comma delimited or Pipe delimited etc)
OPTIONALLY ENCLOSED BY specifies that data fields may also be enclosed by quotation
marks.
TRAILING NULLCOLS clause tells SQL*Loader to treat any relatively positioned columns that
are not present in the record as null columns.
Loading a fixed format data file:
LOAD DATA
INFILE sample.dat
INTO TABLE emp
( empno
ename
job
mgr
sal
comm
deptno
TRAILING NULLCOLS
(
name Filler,
Empno ,
sal
)
here the column name will be skipped.
1) Load multiple files into a single table:
SQL LOADER lets you load multiple data files at once into a single table. But all the data files
should be of the same format.
Here is a working example:
Say you have a table named EMP which has the below structure:
Column
Data Type
emp_num
Number
emp_name Varchar2(25)
department_num
Number
department_name Varchar2(25)
You are trying to load the below comma delimited data files named eg.dat and eg1.dat:
eg.dat:
7369,SMITH,7902,Accounting
7499,ALLEN,7698,Sales
7521,WARD,7698,Accounting
7566,JONES,7839,Sales
7654,MARTIN,7698,Accounting
eg1.dat:
1234,Tom,2345,Accounting
3456,Berry,8976,Accounting
The Control file should be built as below:
LOAD DATA
INFILE eg.dat File 1
INFILE eg1.dat File 2
APPEND
INTO TABLE emp
FIELDS TERMINATED BY ,
( emp_num, emp_name, department_num, department_name )
2) Load a single file into multiple tables:
SQL Loader lets you load a single data file into multiple tables using INTO TABLE clause.
Here is a working example:
Say you have two tables named EMP and DEPT which have the below structure:
Table Column
Data Type
EMP emp_num
Number
Number
If the data file is a delimited file and it has a header included in it, then this can be achieved
by referring the field preceded with : eg description (:emp_name).
If the data file is delimited file without a header included in it, Position (start_pos:end_pos)
or (:field) will not work. This can be achieved using POSITION (1) clause which takes you to
the beginning of the record.
Here is a Working Example:
The requirement here is to load the field emp_name in the data field into two columns
emp_name and description of the table EMP. Here is the Working Example:
Say you have a table named EMP which has the below structure:
Column
Data Type
emp_num
Number
emp_name Varchar2(25)
description Varchar2(25)
department_num
Number
department_name Varchar2(25)
You are trying to load the below comma delimited data file named eg.dat which has 4 fields
that need to be loaded into 5 columns of the table EMP.
eg.dat:
7369,SMITH,7902,Accounting
7499,ALLEN,7698,Sales
7521,WARD,7698,Accounting
7566,JONES,7839,Sales
7654,MARTIN,7698,Accounting
Control File:
LOAD DATA
INFILE eg.dat
APPEND
INTO TABLE emp
FIELDS TERMINATED BY ,
(emp_num,
emp_name,
desc_skip FILLER POSITION(1),
description,
department_num,
department_name)
Explanation on how SQL LOADER processes the above CTL file:
4) Usage of BOUNDFILLER
BOUNDFILLER is available with Oracle 9i and above and can be used if the skipped columns
value will be required later again.
Here is an example:
The requirement is to load first two fields concatenated with the third field as emp_num
into table emp and Fourth field as Emp_name
Data File:
1,15,7369,SMITH
1,15,7499,ALLEN
1,15,7521,WARD
1,18,7566,JONES
1,20,7654,MARTIN
The requirement can be achieved using the below Control File:
LOAD DATA
INFILE C:\eg.dat
APPEND
INTO TABLE EMP
FIELDS TERMINATED BY ,
(
Rec_skip BOUNDFILLER,
tmp_skip BOUNDFILLER,
Emp_num (:Rec_skip||:tmp_skip||:emp_num),
Emp_name
)
5) Load the same record twice into a single table:
SQL Loader lets you load record twice using POSITION clause but you have to take into
account whether the constraints defined on the table allow you to insert duplicate rows.
Below is the Control file:
LOAD DATA
INFILE eg.dat
APPEND
INTO TABLE emp
FIELDS TERMINATED BY ,
( emp_num, emp_name, department_num, department_name )
INTO TABLE emp
FIELDS TERMINATED BY ,
(emp_num POSITION(1),emp_name,department_num,department_name)
SQL LOADER processes the above control file this way:
First INTO TABLE clause loads the 4 fields specified in the first line of the data file into the
respective columns (emp_num, emp_name, department_num, department_name)
Field scanning does not start over from the beginning of the record when SQL LOADER
encounters the second INTO TABLE clause in the CTL file. Instead, scanning continues where
it left off. Statement emp_num POSITION(1) in the CTL file forces the SQL LOADER to read
the same record from the beginning and loads the first field in the data file into emp_num
column again. The remaining fields in the first record of the data file are again loaded into
respective columns emp_name, department_num, department_name. Thus the same
record can be loaded multiple times into the same table using INTO TABLE clause.
6) Using WHEN to selectively load the records into the table
WHEN clause can be used to direct SQL LOADER to load the record only when the condition
specified in the WHEN clause is TRUE. WHEN statement can have any number of
comparisons preceded by AND. SQL*Loader does not allow the use of OR in the WHEN
clause.
Here is a working example which illustrates how to load the records into 2 tables EMP and
DEPT based on the record type specified in the data file.
The below is delimited data file eg.dat which has the first field as the record type. The
requirement here is to load all the records with record type = 1 into table EMP and all the
records with record type = 2 into table DEPT and record with record type =3 which happens
to be the trailer record should not be loaded.
1,7369,SMITH
2,7902,Accounting
1,7499,ALLEN
2,7698,Sales
1,7521,WARD
2,7698,Accounting
1,7566,JONES
2,7839,Sales
1,7654,MARTIN
2,7698,Accounting
3,10
Control File:
LOAD DATA
INFILE eg.dat
APPEND
Thus you can selectively loads the necessary records into various tables using WHEN clause.