What it does
Watches competitors' (or your own) XML sitemaps and lists every page added or removed since the last run, with an alert when something changes. The first run records the starting point. Each row is a site (sitemap.xml is assumed; give sitemap_url if it lives elsewhere). Sitemap indexes are followed.
How it works
- Decides what to do next
- Reads the feed or sitemap
- Goes through each item
- Adds rows to your sheet
- Alerts you
- Sends a chat message
All 18 steps (as they appear in the app)
- _sitemap = {{sitemap_url}}
- If _sitemap empty
- _sitemap = {{site}}/sitemap.xml
- Read feed {{_sitemap}} → _map
- For each pg in {{_map}} (0 steps)
- pages_now = {{pg_count|0}}
- For each new in {{_map_added}} (1 steps)
- Add row: change, page, last_modified
- For each gone in {{_map_removed}} (1 steps)
- Add row: change, page
- added = {{new_count|0}}
- removed = {{gone_count|0}}
- first_run = {{_map_baseline|no}}
- _changes = {{added}} + {{removed}}
- If _changes greater 0
- Notify: Sitemap changed: {{site}}
- If alert_slack equals yes
- Slack: Sitemap changed: {{site}} {{added}} page(s) added
Sample data included
The template comes with sample rows like these, so you can see it work before using your own list.
| site | sitemap_url |
|---|---|
| https://www.example.com |
Get this template
1. Download Develofly Autopilot: free, for Ubuntu and other Linux desktops.
Download Develofly Autopilot2. The app comes with every template, so this one is already in your library. Click below to open it (or find it under Templates).
Open in AutopilotWhat you need
- A spreadsheet (CSV or Excel) — a sample is included
You fill in: Also send alerts to Slack.
Make it yours
Every step is editable in the app: change the site, the columns, the schedule, or chain it with other bots. Run it once, on a schedule, or sell it as your own bot.