Agenty SFTP workflow allows you to upload your agent result CSV file to your FTP or SFTP server automatically.
SFTP is a secure file transfer protocol method and a very popular way for securely transferring files to remote servers. Our SFTP integration helps you to transfer your scraping agent result to your SFTP server automatically.
You can simply attach a SFTP plugin to your agent with details like - Host (IP address) and port number with credentials to allow a connection from Agenty to your FTP server. Once configured, your web scraping result will be automatically transferred to your FTP server every-time a scraping agent completes the jobs execution, either its an on-demand scraping service or the scheduled extraction.
How SFTP Integration works with Agenty. Let’s see step by step:
Configure SFTP Integration
-
Go to the Workflow tab
-
Choose the SFTP workflow
- This will open the SFTP configuration form
- Select the web scraping agent where you want to add this workfow to (the workflow will be triggered automatically on job completion.)
- Enter the
host,port,username,password,pathandnameof the file.
- You may also use dynamic parameters to generate the file name dynamically on runtime.
- Save the configuration
- And run your agent.
Logs and Result
- Click on the “Start” button to run your scraping agent
- Go to “Logs” tab to see the logs trace when the job has been completed
2023-08-07T09:28:27.479Z INFO Backup completed successfully
2023-08-07T09:28:27.555Z INFO Running workflow #64d0b92216d4f492bdebc7d0 (SFTP workflow)
2023-08-07T09:28:27.559Z INFO Running action: sftp on job completed
2023-08-07T09:28:27.562Z INFO Connecting to: 121.34.22.198:22
2023-08-07T09:28:27.562Z INFO Uploading Job-110981-08052019-output.csv (1,122 bytes)
2023-08-07T09:28:27.562Z INFO File uploaded successfully
