Our crawler — for publishers
সর্বশেষ হালনাগাদ: September 20, 2026
Who we are
কী মিস করলাম! (kimisskorlam.com) is a Bangladeshi reader that shows what happened, grouped by topic, and sends readers to the original reporting. Our automated fetcher identifies itself as:
kimisskorlam-ingestor/1.0 (+https://kimisskorlam.com/bot)
What it fetches
- Your public RSS feed, or your Google-News sitemap where you publish one.
- For a topic's picture: the
og:imageof a page thatrobots.txtlets us fetch.
From that we keep the headline, a short excerpt (at most 300 characters), your thumbnail's address and the link, and we show your outlet's name with every item. We do not store or display full articles.
How it behaves
- It obeys
robots.txtfor every URL it fetches, and skips a site that disallows it. - A handful of requests per outlet every two hours; no crawling of article archives.
- It only requests public addresses, and does not attempt to get around firewalls or bot protection.
Allow-list, opt out, or ask us anything
If your firewall blocks our fetcher and you'd like to be included, allow-list the user agent above or tell us the feed address you prefer. If you would rather not appear, say so and we will remove your outlet and its items promptly. Write to support@kimisskorlam.com or use the contact form.