3 - Setup BigObject output plugin
Which is the most simplest part. Please reference README for up-to-date configuration. install bigobject input plugin
embulk gem install embulk-output-bigobject
sample config.yml as following
in:
type: file
path_prefix: /Users/randy/GitHub/embulk/try1/csv/part-
parser:
charset: UTF-8
type: csv
newline: CRLF
delimiter: ','
quote: '"'
escape: '"'
trim_if_not_quoted: false
allow_extra_columns: false
allow_optional_columns: false
columns:
- {name: sourceIP, type: string}
- {name: destURL, type: string}
- {name: visitDate, type: timestamp, format: '%Y-%m-%d'}
- {name: adRevenue, type: double}
- {name: userAgent, type: string}
- {name: countryCode, type: string}
- {name: languageCode, type: string}
- {name: searchWord, type: string}
- {name: duration, type: long}
out:
type: bigobject
host: 192.168.99.100
table: testamplab
Run the Embulk & Have fun!!!
embulk run config.yml