## About the role
You'll review real merchant conversations where Shopify’s Sidekick answered an **analytics or** **segmentation** question and the merchant was unhappy — pinpoint the failing query or filter, determine what it should have been, and categorize the error against a detailed rubric.
## What you'll do
- Read multi-turn merchant ↔ agent conversations, including tool-call cards and the data they return
- Identify the query or segment filter the assistant generated, and determine the correct version
- Categorize why the response fell short (wrong metric/dimension/filter, unsupported report, etc.)
- Write concise, objective explanations of what went wrong
- **Commitment:** ~5–10 hours/week
## Qualifications
**Required:**
- **Strong general SQL** — comfortably read, write, and critique queries: `WHERE` vs `HAVING`, `GROUP BY`, `ORDER BY` / `LIMIT`, joins, and aggregation. You should be able to look at a query and say what it returns and what's wrong with it.
**Strongly preferred:**
- **Hands-on Shopify merchant experience** — you've run or operated a Shopify store and know how merchants actually use analytics and segmentation.
- **First-hand experience using Sidekick** — you've used Shopify's Sidekick AI assistant yourself.
**Preferred (nice to have — we'll help you ramp on the specifics):**
- Familiarity with **Shopify analytics / ShopifyQL** and the Shopify data model — the schemas (`sales`, `payments`, `sessions`, `fulfillments`, `customers`), metric nuances (e.g. `net_items_sold` includes returns vs `quantity_ordered`; revenue vs unit counts for "best-selling"), and the segmentation model (`products_purchased MATCHES`, operators, `AND`/`OR` connectors).
- General e-commerce / analytics ops experience.
Rate: $60.0-$60.0 USD/hourly
Commitment: hourly
Domain: Data Analysis
Referral Bonus: $240.0
Hours/week: 10
Open slots: 2
Note: This is a third party job (Aggregated by careeruplift.ai). Shortlisting and Final hiring decision & process is handled by the company.