Agenty Shopify integration allow you to automatically crawl the products from your manufacturer or supplier websites(even password protected) and upload to your Shopify store, update prices, images and more.
Shopify is most popular eCommerce platform and used by 600,000+ businesses to create their online stores, without writing any code to make your website live.
All you need is — Signup and upload your products to create an eCommerce website in few minutes. And their built-in templates and apps marketplace makes it even more easier for businesses to launch their eCommerce store online and start selling products globally in no time.
Our Shopify integration allows you to :
- Crawl manufacturer, supplier and brands website to download the products
- Transform the products to match with your Shopify store format, change price to add profit etc. and finally upload the products to your store
- Schedule the crawler to find new products daily, weekly and upload to your store
- Schedule the crawler to update price, out-of-stock, inventory quantity to sync with the source website for better inventory management.
With all the custom rule and logic’s before uploading to your Shopify store, for example:
- Add a custom script to increase the price by 10% to add your margin.
- Replace “USD” with “$” in price field or something else using the built-in post-processing functions
- Remove “By manufacturer name” form product title
- And any other custom rule…
Prerequisites
- Good knowledge of Agenty web scraping tool to scrape data from supplier websites
- Credentials of supplier website, if password protected. (see docs here to learn how to crawl password protected site
- A Shopify store
- Agenty professional or higher plan to get access of Shopify plugin
Shopify Connector
- Go to Agenty connections page
- Add new connection
- Select Shopify and enter your Store URL
- Click on “Connect to Shopify” button and you’ll be redirected to Shopify for authorization.
- Authorize Agenty to by clicking on the “Install app” button.
- Give the permissions to
read_products,write_productsandwrite_inventory - Once connected successfully, Shopify will redirect you back to Agenty with Oauth token to access your store for product and stock sync.
Setup your scraping agent
The web scraping agents MUST have following fields with exact same name to map them with Shopify API to sync inventory between your Shopify store and the supplier website.
| Field Name | Data Type | Description |
|---|---|---|
| url | string (mandatory field) |
Product URL of vendor website, this will be used as reference to sync the products (update price, quantity etc.) and avoid duplicates |
| title | string (mandatory field) |
Product title |
| vendor | string | Brand or vendor name |
| body_html | string | HTML body of the product |
| product_type | string | The type of products, e.g mobiles, books, laptops etc. |
| tags | string | Comma separated tags |
| images | string | Comma separated images URLs |
| price | number | Product price in decimal format. (Agenty will automatically remove any non number or period character(if any) while converting the price into valid decimal format.) |
| compare_at_price | number | Product compare at price in decimal format to show discount. (Agenty will automatically remove any non number or period character(if any) while converting the price into valid decimal format.) |
| inventory_quantity | number | In stock quantity of products in number format. Agenty will automatically remove any non number character(if any) while converting the quantity into valid number format. By default : 1
|
Variants importing
If your product has variants like color or sizes. Just add option1 field to attach the variants with product while importing with your Shopify store.
| Field Name | Data Type | Description |
|---|---|---|
| sku | string | Product SKU |
| option1 | string | Name of the variant |
| price | number | Price of the variant |
| inventory_quantity | number | Inventory quantity |
Here is an example agent with size variants scraping
If you do not know how to create a scraping agent? I’d recommend to watch this video here or read this post first.
Configure Shopify Plugin
-
Go to Agenty integrations page
-
Click on the Add button on Shopify plugin row to setup
-
A new page will open where we need to select the web scraping agent, where the integration will be attached and also select your Shopify store connection we just connected on step #1
-
Profit percentage : Use the profit percentage text box to add the margin percentage. Agenty will increase the extracted price by a given percentage number to add your profit margin automatically.
-
Rounds up : Use the rounds up switch to enable/disable the rounding off. When enabled, the price will be rounded by next 10, for example 198.99 will become 200; and 92.5 will become 100.
-
Save the integration by clicking on “Save” button.
Start the scraper
- Go to your agent page
- Click on the Start button. (Remember : Don’t enter all URLs in input, if you are testing the scraper because that will run longer and consume your pages
credit while testing)
Alternatively, you can also use our API to start a scraping job
curl -X POST -H "Content-type: application/json" -d '{
"agent_id":"{AGENT ID HERE}"
}' 'https://api.agenty.com/v2/jobs/start?apikey={API KEY HERE}'
The job will take few minutes, depending on the number of web pages you are crawling and also your plan limitation.
Once the job has been completed, check the trace logs and you’ll find messages like :
Shopify sync started...
Product created successfully- Shopify Id: 1644195479605
No updated available - Shopify Id: 1644196003893
Product created successfully- Shopify Id: 1644196003887
Product updated successfully- Shopify Id: 1644196003862
Check your store
Now the agent has been completed successfully, check your Shopify store and you’ll find that all the scraped products have been uploaded to your store.
