Skip to main content

Lesson 15: XML Sitemaps & Robots.txt Custom Settings (Technical setup for Blogger website)

 

Lesson 15: XML Sitemaps & Robots.txt Custom Settings (Technical setup for Blogger website)

Pechli post mein humne seekha ke Internal Linking kya hoti hai aur kaise posts ko aapas mein jor kar ranking boost ki jati hai. Agar aapne wo ahem lesson miss kar diya hai, toh niche diye gaye roadmap link se check kar sakte hain.

Aaj se hamara Technical SEO ka safar shuru ho raha hai, aur iska sab se pehla aur buniyaadi sabaq hai: XML Sitemaps & Robots.txt Custom Settings for Blogger.

Technical SEO ka matlab hai apni website ke backend ko search engines (jaise Google, Bing, Yahoo) ke liye itna aasan aur saaf banana ke unke crawlers (bots) bina kisi rukawat ke aapki saari posts ko parh aur index kar sakein. Agar aapka sitemap aur robots.txt ghalt configured hai, toh Google aapki website ko block samajh kar chhor dega. Chalein is mega-guide mein in dono buniyaadi settings ko bilkul perfect tarike se setup karna seekhte hain.

📑 Part 1: XML Sitemap Kya Hai aur Yeh Kyun Zaroori Hai?

XML Sitemap buniyaadi tor par aapke blog ka ek "Digital Map (Naqsha)" hota hai. Yeh ek aisi file hoti hai jismein aapke blog ki saari posts, pages, aur categories ke links ek tarteeb mein mojood hote hain.

  • Kyun Zaroori Hai? Jab aap apne blog par koi naya article publish karte hain, toh Googlebot ko automatic sapne nahi aate ke aapne kuch naya likha hai. Googlebot aapke XML sitemap ko check karta hai, wahan naye link ko dhoondta hai, aur use fauran crawl karke Google Search par live (index) kar deta hai.

  • Blogger Ka Default Sitemap: Blogger automatic aapka ek sitemap bana deta hai, lekin jab aapki posts 500 se zyada ho jati hain, toh default sitemap kaam karna chhor deta hai. Is liye hume hamesha custom sitemap submit karna chahiye.

Google Search Console Mein Submit Karne Ka Sahi Formula:

Blogger ke liye aapko koi file download nahi karni parti. Aapko sirf apne Google Search Console mein ja kar Sitemaps par click karna hota hai aur wahan apna URL likh kar aage exact yeh code submit karna hota hai:

Plaintext
sitemap.xml

Ya agar aapka blog bada hai, toh aap yeh professional syntax bhi use kar sakte hain:

Plaintext
atom.xml?redirect=false&start-index=1&max-results=500

🤖 Part 2: Custom Robots.txt Settings (Blogger Backend)

Robots.txt ek aisi text file hoti hai jo search engine ke bots ko hidayat (instructions) deti hai ke website ke kaun se hisse ko crawl karna hai aur kaun se hisse ko block (disallow) karna hai.

Agar aap Blogger ke backend mein ja kar Settings -> Crawlers and indexing mein bina samjhe fuzool settings on kar dein ge, toh aapka poora blog Google se de-index ho sakta hai.

🛠️ Guide Earning 2026 Ka Perfect Custom Robots.txt Code:

Blogger par hamesha niche diya gaya code copy karke Custom robots.txt wale box mein paste karein (Apni website ka URL lagana mat bhoolie ga):

Plaintext
User-agent: *
Disallow: /search
Allow: /

Sitemap: https://yourdomain.com/sitemap.xml

💡 Is Code Ka Technical Matlab Kya Hai?

  1. User-agent: * -> Yeh line duniya ke saare search engines (Google, Bing, DuckDuckGo) ke bots ko ijazat deti hai ke wo aapke blog par aa sakte hain.

  2. Disallow: /search -> Yeh bhot ahem line hai. Iska matlab hai ke blog ke search labels aur URL filtering pages ko Google index na kare, kyunke is se website par Duplicate Content ka error aata hai.

  3. Allow: / -> Iska matlab hai ke poore blog ki saari posts aur pages ko crawl karne ki mukammal ijazat hai.

  4. Sitemap: -> Yeh bot ko direct aapke sitemap ka rasta dikha deta hai taake use links dhoondne mein aasaani ho.

⚙️ Part 3: Custom Robots Header Tags Setup (Step-by-Step)

Blogger settings mein Robots.txt ke thik niche Custom robots header tags ka option hota hai. Isay active karne ka sahi rasta yeh hai:

1.Enable Header Tags:Blogger Backend.

Blogger Dashboard open karein -> Settings par jayein -> Niche scroll karke Crawlers and indexing par aayein. Enable custom robots header tags ko ON kar dein.

2.Home Page Tags Setting:Prerequisite.

Home page tags par click karein. Yahan sirf all aur noodp (agar show ho) ko check/ON karein, baaki sab ko OFF chhor dein aur save karein.

3.Archive and Search Page Tags:Duplicate Content Prevention.

Archive and search page tags par click karein. Yahan noindex aur nofollow ko check/ON karein. (Yeh aapke label pages ko index hone se rokta hai jo ke SEO ke liye zaroori hai).

4.Post and Page Tags Setting:Main Content Indexing.

Post and page tags par click karein. Yahan all aur noodp ko check/ON karein aur save kar dein. Is se aapki main posts Google par rank hone ke liye ready ho jati hain.

📋 Technical SEO Indexing Checklist

Apna setup mukammal karne ke baad in cheezon ko check lazmi karein:

🚀 Agla Qadam (Next Lesson & Technical Mastery)

Technical SEO ka buniyaadi dhancha khara karne ke baad, ab hamara sab se ahem aur dhmakedar sabaq aata hai jise hum kehte hain Google Search Console Setup & Verification—yani apne blog ko offically Google ke daftar mein register karwana taake hum live traffic aur errors ko monitor kar sakein.

Hamari agli mega-guide parhein: Post 16: Core Web Vitals Tutorial (LCP, FID/INP, aur CLS optimize karke site speed barhayein).https://guideearning2026.blogspot.com/2026/06/core-web-vitals-tutorial-site-speed.html

💡 Agar aapne is course ka koi sabaq miss kar diya hai, ya aap buniyaadi setups jaise Internal Linking ya Topical Authority seekhna chahte hain, toh hamara mukammal roadmap check karein:

👉 SEO Mastery Course 2026 – Complete Roadmap Page

https://guideearning2026.blogspot.com/p/seo-mastery-course-2026-free-blogging.html
Labels:

Comments

Post a Comment

Popular posts from this blog

What is SEO? Complete Beginner Guide (SEO kya hai aur yeh kaise kaam karta hai)

What is SEO? Complete Beginner Guide (SEO kya hai aur yeh kaise kaam karta hai) Agar aap 2026 mein apna blog shuru kar rahe hain ya freelancing ki duniya mein qadam rakh rahe hain, toh ek lafadh aapko har jagah sunne ko milega — SEO . Aksar naye bloggers ko lagta hai ke SEO koi bohat mushkil ya technical cheez hai, lekin haqeeqat yeh nahi hai. Agar aap isko aasan alfaaz mein samajh lein, toh aap apne blog par hazaron-laakhon ki traffic bilkul free mein la sakte hain. Guide Earning 2026 ke is exclusive course ki pehli post mein hum bilkul zero se seekhein ge ke SEO kya hai aur yeh kaam kaise karta hai. 🔍 SEO Kya Hai? (What is SEO?) SEO ka matlab hota hai Search Engine Optimization . Yeh ek aisa tareeqakar (process) hai jis ki madad se aap apne blog aur uske content ko is tarah design aur optimize karte hain ke jab bhi koi user Google, Bing, ya kisi aur search engine par kuch search kare, toh aapka blog Pehle Page (First Page) par nazar aaye. Aasan Misaal: Farz karein aapne ek post ...
2 comments
Read more

Lesson 26 – How to Use Facebook for Blog Traffic Growth

  📖 Lesson 26 – How to Use Facebook for Blog Traffic Growth Introduction Facebook remains one of the most powerful platforms for bloggers to increase traffic and audience engagement. Many successful bloggers use Facebook pages, groups, and content sharing strategies to attract visitors to their websites. Facebook can help bloggers: increase traffic build audiences improve engagement promote blog content strengthen branding In this lesson, you will learn how bloggers use Facebook professionally for blog traffic growth in 2026. Why Facebook is Important for Bloggers Facebook has billions of active users worldwide. It helps bloggers: reach new audiences promote articles build communities increase visibility Social media traffic can support long-term blog growth. Step 1 – Create a Professional Facebook Page A professional page improves trust and branding. Your page should include: blog logo clear description website link professional cover image A clean page creates a better first im...
2 comments
Read more

Lesson 37 – Professional Backlink Building Strategies for Bloggers

  📖 Lesson 37 – Professional Backlink Building Strategies for Bloggers Introduction Backlinks remain one of the most important ranking factors in SEO. A backlink is simply a link from another website pointing to your blog. Search engines such as Google often view quality backlinks as votes of confidence. The more trustworthy websites link to your content, the stronger your website's authority can become. However, modern SEO focuses on quality over quantity . A few high-quality backlinks are often more valuable than hundreds of low-quality links. In this lesson, you will learn professional backlink building strategies used by successful bloggers in 2026. What Are Backlinks? Backlinks are links from other websites that direct users to your content. Example: Website A links to your article. That link becomes a backlink for your website. Backlinks help search engines discover content and measure website authority. Why Backlinks Matter Quality backlinks can help: imp...
1 comment
Read more