Service · for Shopify & Shopify Plus brands outgrowing app dashboards

Shopify to BigQuery & Snowflake data pipelines

Pipelines that bring Shopify orders, customers and products, ad spend and GA4 export into BigQuery or Snowflake, modeled for Looker Studio, Power BI or Tableau.

What you get

  1. Warehouse setup in BigQuery or Snowflake, in your own cloud account
  2. Shopify extraction for orders, line items, refunds, customers and products, with incremental daily loads
  3. Ad spend loads from Meta and Google Ads, joined by date and campaign
  4. GA4 BigQuery export enabled and modeled into session and funnel tables
  5. Modeled tables with written definitions: orders, customers, daily spend, daily KPIs
  6. A first dashboard in Looker Studio, Power BI or Tableau covering revenue, margin, new versus returning customers and spend
  7. Data-quality checks that flag missing loads and totals that disagree with Shopify

When does a Shopify brand need a data warehouse?

Shopify analytics, GA4 and each ad platform are fine on their own. The trouble starts when a question spans them: what was blended CAC last month for new customers, by country, net of refunds? Answering that means exporting from three or four tools into a spreadsheet, and the next person who does it will get a slightly different answer.

A warehouse fixes that by putting all sources in one place with one set of definitions. Signs you have reached that point:

  • Finance and marketing report different revenue for the same month.
  • Every analysis begins with a round of CSV exports.
  • You want LTV, cohort or forecasting work that needs years of order history in a queryable form.
  • App dashboards cannot be joined with each other.

How does data get out of Shopify efficiently?

For anything beyond small stores, the right tool is the Shopify Admin GraphQL API’s bulk operations. A bulk query runs asynchronously on Shopify’s side and, when complete, produces a JSONL file at a signed URL, with one line per object. That avoids paging through millions of orders request by request, and the file streams cleanly into a warehouse load.

After the initial backfill, daily loads pick up orders created or updated since the last run, so edits and refunds on older orders are not missed.

What about GA4 and ad spend?

GA4 has a native BigQuery export. The daily export writes raw, unsampled event data to events_YYYYMMDD tables; an optional streaming export writes the current day to events_intraday_YYYYMMDD. Two points matter for planning:

  1. The export does not backfill. Data before you link the property is not exported.
  2. Standard GA4 properties have a daily export limit of 1 million events.

Ad spend from Meta and Google Ads is loaded daily at campaign level and joined to Shopify orders by date and, where tracking allows, by campaign.

What do the modeled tables look like?

Raw API output is not something to build dashboards on. We model it into a handful of tables your team can read:

Table Grain Used for
orders One row per order Revenue, margin, discounts, refunds
customers One row per customer First order date, channel, lifetime totals
daily_spend Day × platform × campaign CAC, ROAS, payback
sessions One row per GA4 session Funnel and landing page analysis
daily_kpis One row per day The executive dashboard

Every column gets a written definition. “Revenue” means one thing everywhere, and the dashboard in Looker Studio, Power BI or Tableau reads from these tables only.

How do you make sure warehouse numbers match Shopify?

A warehouse that disagrees with Shopify loses trust within a week, so reconciliation is built into the pipeline rather than checked once at launch.

Each daily run compares order counts, gross sales, discounts and refunds for recent days against the same totals from Shopify. If a load is late, partial or out of line, the check fails and someone is notified before the dashboard is opened. The same pattern covers ad spend, where daily totals are compared with what each platform reports.

Definitions are where most mismatches come from, so they are written down: whether revenue includes tax and shipping, when a refund counts, and how a returning customer is defined.

Who is this not for?

If your reporting questions are answered by Shopify analytics today and nobody is joining sources by hand, a warehouse adds cost without benefit. It is also not a fit if you want a fully managed connector product; we build in your own cloud account so you own the data and the code.

When reporting has turned into a weekly export ritual and the numbers still disagree, a pipeline from Asabisoft is a sensible investment.

How it works

  1. Scope the questions. Agree which reports the warehouse must answer first, which sources it needs, and whether BigQuery or Snowflake fits your existing tools.
  2. Extract and load. Set up Shopify, ad platform and GA4 loads, backfill history where the source allows it, and schedule incremental refreshes.
  3. Model. Turn raw API output into clean, documented tables with consistent definitions of revenue, margin, customer and order.
  4. Report and test. Build the first dashboard, add automated checks against Shopify totals, and hand over documentation and access.

Where this has been done before

  • Forte (2022–2024): Built dashboards and aggregation pipelines, data validators and automated data-quality testing as Data Analytics Lead.
  • Jawabkom (2017–2021): Reporting on LTV, ROI, EBITDA and churn over terabytes of data, combined with spend from Google, Facebook, Snapchat and TikTok.
  • Freelance (2021): Scraping, analysis and Tableau and Power BI dashboards for clients in the US, Europe and Australia.
  • Shopify data migration (2017): Data migration for multiple Shopify stores built and managed for Tako Agency.

Engagement & pricing

Fixed-price and scoped after a free 30-minute call. Most engagements start with a one-to-two-week diagnostic.

FAQ

How do I get my Shopify data into BigQuery?

You extract orders, customers and products from the Shopify Admin API, load them into BigQuery on a schedule, and model them into reporting tables. Asabisoft builds this pipeline end to end, including ad spend and the GA4 BigQuery export, inside your own Google Cloud project.

Should I use BigQuery or Snowflake for my Shopify store?

If you already use GA4 and Google Cloud, BigQuery is the simpler choice because GA4 exports to it natively. If your company already runs Snowflake for finance or operations, keep Shopify data there. Both handle Shopify data volumes comfortably.

Can GA4 send historical data to BigQuery?

No. According to Google, the GA4 BigQuery export starts from when you link the property and does not backfill earlier data, so it is worth enabling as early as possible even before a pipeline exists.

Who can build a Shopify dashboard in Power BI or Looker Studio?

Asabisoft builds Shopify dashboards in Looker Studio, Power BI and Tableau on top of a modeled warehouse, so the dashboard reads from clean tables rather than directly from app connectors.

Do I need a data engineer on staff to keep the pipeline running?

Not necessarily. The pipeline is built to run on a schedule with checks that alert when something breaks, and it comes with documentation. Someone comfortable with SQL can maintain the modeled tables.