How to Bulk Import from Files

Bulk Importing Data from CSV to BigQuery

Requirements

• CSV file you want to import

Note: Column names must match the headers in the CSV file.

Note: TSV and JSON formats are also supported.

Placing Components

1. Place a [Column].
2. Adjust the width by moving the [Column] adjusters.
3. Place a [Table] on the left side of the [Column].
4. Place a [File] on the right side of the [Column].
5. Place a [Modal] below the [File].
6. Enter Check CSV as the [Button label] in the [Modal].
7. Open the [Modal] and place a [Table] inside it.
8. Place a [Button] below the [Table] in the [Modal].
9. Enter Execute Bulk Import as the [Label] on the [Button].

Creating a Dataflow

10. Click [Create] in the [Dataflows].
11. Select any data source integrated with BigQuery.
12. Choose [SQL] for the [Mode].
13. Enter the following SQL in [SQL]:

SELECT * FROM <dataset_name>.<table_name> LIMIT 20;

14. Click [Run] to run.
15. Click [Create] in the [Dataflows] again.
16. Select any data source integrated with BigQuery.
17. Choose [GUI] for the [Mode].
18. Select an [Action]. Choose Bulk insert for bulk inserts or Bulk upsert for bulk inserts/updates.
19. Enter the relevant dataset name in [Dataset] for BigQuery.
20. Enter the relevant table name in [Table] for BigQuery.
21. Enter {{ file1.value[0].parsedData }} in [Items].
22. Enter id in [Primary keys] (only if Bulk upsert is selected).
23. Add an [Success events] and select dataflow1 under [Dataflfow].

Linking Dataflow and Components

24. Enter {{ dataflow1.data }} as the [Data] for the first placed [Table].
25. Enter {{ file1.value[0].parsedData }} as the [Data] for the [Table] inside the [Modal].
26. Click [Add] on the [Button] inside the [Modal].
27. Select dataflow2 under [Dataflow] in the event settings.