Hi there!
We blocked a subdirectory using robots.txt (on purpose) and later we removed it but this page is still not being crawled. Could you please tell what could be the reason?
URL: https://www.userlane.com/solutions/jira-software-training
Robots.txt: https://www.userlane.com/robots.txt.
Sitemap: https://www.userlane.com/sitemap.xml
FACTS:
- I have created a customized sitemap and including the page
- Sub-directory “solutions” has been removed from the robots.txt.
- Page is not blocked by the meta-noindex tag
Any help will be highly appreciated!