Snowflake Delivery Configuration Guide

Snowflake configuration is available for ‘Datasets’ delivery and not available for data collectors (Web Scraper).

Getting Started

In order to allow efficient delivery of Datasets to your Snowflake environment, we provide a step-by-step guide to set it up. Just follow these steps:

Select or Create a Database

Firstly, decide if you will use an existing database or create a new one. If you opt for a new database, here’s the command you need:

CREATE DATABASE <database>;

Remember to replace <database> with the name you want for your database.

Select or Create a Schema

Decide if you will use an existing schema or create a new one. By default every database has a PUBLIC schema. If you wish to use a different schema, here’s the command you need:

CREATE SCHEMA <schema>;

Replace <schema> with your own schema name.

Select or Create a Warehouse

Choose an existing warehouse or create a new one. When creating a new warehouse, consider Snowflake’s recommendations for configuring a warehouse specifically for data loading. Use the following command to create a warehouse:

CREATE WAREHOUSE <warehouse>;

Replace <warehouse> with your desired warehouse name.

Select or Create an Internal Named Stage

Next, choose an existing internal named stage or create a new one. To create a new stage, use this command:

CREATE STAGE <stage>;

Don’t forget to replace <stage> with your preferred stage name.

Create a Role

You’ll need a role that can write to your chosen stage. To create one, use:

CREATE ROLE <role_name>;

Change <role_name> to your chosen role name.

Grant Warehouse Rights to the Role

Now, grant your new role the necessary rights to operate on your chosen warehouse using:

GRANT OPERATE ON WAREHOUSE <warehouse> TO ROLE <role_name>;

Remember to replace <warehouse> and <role_name> with your specific warehouse and role name respectively.

Enable Write Operations on the Stage for the Role

To enable your role to write on the stage, use the command:

GRANT WRITE ON STAGE <stage> TO ROLE <role_name>;

Again, replace <stage> and <role_name> with your chosen stage and role names.

Create a BrightData User

Next, create a new user for BrightData that will be used to upload data directly into Snowflake. The command is as follows:

create user <user_name>
PASSWORD = '<password>'
LOGIN_NAME = <login>
MUST_CHANGE_PASSWORD = FALSE
DISABLED = FALSE
COMMENT = 'user for BrightData to upload data directly into Snowflake'

Replace <user_name>, <password>, and <login> with your chosen username, password, and login name.

Grant Role Privileges to the New User

Finally, grant your new user the privileges of the role you created:

GRANT ROLE <role_name> TO USER <user_name>;

Replace <role_name> and <user_name> with your role and user names.

Allowlist IPs

If you have an active Network Policy applied in your Snowflake account you need to whiltelist following IPs:

ALTER NETWORK POLICY <policy_name>

SET ALLOWED_IP_LIST=(
    <existing_allowlisted_ips>,
    '35.169.71.210',
    '34.233.211.38',
    '44.194.183.74',
    '54.243.177.151'
);

Replace <policy_name> with your network policy name.
Replace <existing_whiltelisted_ips> with the list of existing allowlisted IPs.

And that’s it! You have now configured your Snowflake environment to receive data from our platform.If you have any issues or need further assistance, please contact our support team.If you want to learn more about Data Loading Performance and Warehouse Size Considerations click here.

​Getting Started

Getting Started