Announcement

Collapse
No announcement yet.

What about robots.txt

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

    What about robots.txt



    Does setting up robots.txt file can help in getting miva product pages into
    search engines.

    I have small number of products in my miva shop and could even link to
    single page.

    robert

    P.S. - doesn any of you have example robots.txt file that works with miwa.



    #2
    What about robots.txt



    Won't help at all. robots.txt file is mainly for excluding pages and/or
    certain directories.

    Jason
    JMH Web Services, Inc.
    <A HREF ="http://www.jmhonline.net">http://www.jmhonline.net</A>
    Miva Merchant Development and Search Engine Optimization
    <A HREF ="http://www.jmhonline.net/searchmiva">http://www.jmhonline.net/searchmiva</A>


    > Does setting up robots.txt file can help in getting miva product pages
    into
    > search engines.
    >
    > I have small number of products in my miva shop and could even link to
    > single page.
    >
    > robert
    >
    > P.S. - doesn any of you have example robots.txt file that works with miwa.


    Comment


      #3
      What about robots.txt



      Actually....,

      You can make great use of robot files if you know how to used them =
      effeciently. For example:

      You can create a page that has nothing but a list of links that goes to =
      every single product page in your miva store. Not a very pretty page =
      and one you would not want most customers to see, but using a robat =
      file, you could have the robot go to this page and follow all links =
      from this page, but not index this link page. The results is that when =
      your site is indexed, all your product detail pages are indexed, but =
      this page is excluded so that people would not normally find this page =
      unless they knew it was there.

      here is a great link that provides example uses of robot files and is =
      one fo the greatest sites for SEO information.

      http://spider-food.net/handling-robots.html

      Hope that helps. :0)

      Rich=20




      -----Original Message-----
      From: Jason Henderson [mailto:[email protected]]
      Sent: Tuesday, June 10, 2003 2:13 PM
      To: Robert Jober; [email protected]
      Subject: Re: [mru] What about robots.txt


      Won't help at all. robots.txt file is mainly for excluding pages =
      and/or
      certain directories.

      Jason
      JMH Web Services, Inc.
      <A HREF ="http://www.jmhonline.net">http://www.jmhonline.net</A>
      Miva Merchant Development and Search Engine Optimization
      <A HREF ="http://www.jmhonline.net/searchmiva">http://www.jmhonline.net/searchmiva</A>


      > Does setting up robots.txt file can help in getting miva product =
      pages
      into
      > search engines.
      >
      > I have small number of products in my miva shop and could even link =
      to
      > single page.
      >
      > robert
      >
      > P.S. - doesn any of you have example robots.txt file that works with =
      miwa.


      Comment


        #4
        What about robots.txt



        Richard,

        What do you mean by robot files? There is robot.txt which is one file and
        robot meta tags. It sounds like your are talking about a robot meta tag
        that will tell robots to not index the page but follow the links.<meta
        name="robots" content="noindex,follow"> Why not just make a pretty sitemap
        page and link to it in the normal fashion. If you optimize it properly, it
        can get you significant traffic and sales. There are even two modules that
        will do this for you. I went to that link you gave and all it discusses is
        disallowing robots from indexing directories with the robots.txt file and
        nothing more.

        Jason
        JMH Web Services, Inc.
        <A HREF ="http://www.jmhonline.net">http://www.jmhonline.net</A>
        Miva Merchant Development and Search Engine Optimization
        <A HREF ="http://www.jmhonline.net/searchmiva">http://www.jmhonline.net/searchmiva</A>


        Actually....,

        You can make great use of robot files if you know how to used them
        effeciently. For example:

        You can create a page that has nothing but a list of links that goes to
        every single product page in your miva store. Not a very pretty page and one
        you would not want most customers to see, but using a robat file, you could
        have the robot go to this page and follow all links from this page, but not
        index this link page. The results is that when your site is indexed, all
        your product detail pages are indexed, but this page is excluded so that
        people would not normally find this page unless they knew it was there.

        here is a great link that provides example uses of robot files and is one fo
        the greatest sites for SEO information.

        http://spider-food.net/handling-robots.html

        Hope that helps. :0)

        Rich




        -----Original Message-----
        From: Jason Henderson [mailto:[email protected]]
        Sent: Tuesday, June 10, 2003 2:13 PM
        To: Robert Jober; [email protected]
        Subject: Re: [mru] What about robots.txt


        Won't help at all. robots.txt file is mainly for excluding pages and/or
        certain directories.

        Jason
        JMH Web Services, Inc.
        <A HREF ="http://www.jmhonline.net">http://www.jmhonline.net</A>
        Miva Merchant Development and Search Engine Optimization
        <A HREF ="http://www.jmhonline.net/searchmiva">http://www.jmhonline.net/searchmiva</A>


        > Does setting up robots.txt file can help in getting miva product pages
        into
        > search engines.
        >
        > I have small number of products in my miva shop and could even link to
        > single page.
        >
        > robert
        >
        > P.S. - doesn any of you have example robots.txt file that works with miwa.


        Comment


          #5
          What about robots.txt



          Robots.txt files are actually used to prevent indexing. They do not
          help to gain better search engine placement, but rather to restrict the
          robots and spiders from certain files or subdirectories.

          For more information about robots.txt and how to create them, see the
          following link:

          <A HREF ="http://www.robotstxt.org/wc/robots.html">http://www.robotstxt.org/wc/robots.html</A>

          Vic Vega
          Webmaster,
          WolfPaw Computers
          (877) 31-A-WOLF
          www.wpcomp.com <<A HREF ="http://www.wpcomp.com> ">http://www.wpcomp.com> </A>


          -----Original Message-----
          From: [email protected]
          [mailto:[email protected]] On Behalf Of Robert Jober
          Sent: Tuesday, June 10, 2003 3:58 PM
          To: '[email protected]'
          Subject: [mru] What about robots.txt


          Does setting up robots.txt file can help in getting miva product pages
          into search engines.

          I have small number of products in my miva shop and could even link to
          single page.

          robert

          P.S. - doesn any of you have example robots.txt file that works with
          miwa.


          Comment


            #6
            What about robots.txt



            Yeah yeah your right lol

            Crossing wires here sry. The file prevents indexing of pages and dir, =
            the robo meta tag is what I meant. Sry for the confusion. Thanks for =
            the correct.

            Rich=20

            THANK YOU SIR MAY I HAVE ANOTHER :0)


            -----Original Message-----
            From: Jason Henderson [mailto:[email protected]]
            Sent: Tuesday, June 10, 2003 3:24 PM
            To: Richard Chatfield; Robert Jober; [email protected]
            Subject: Re: [mru] What about robots.txt


            Richard,

            What do you mean by robot files? There is robot.txt which is one file =
            and
            robot meta tags. It sounds like your are talking about a robot meta =
            tag
            that will tell robots to not index the page but follow the links.<meta
            name=3D"robots" content=3D"noindex,follow"> Why not just make a pretty =
            sitemap
            page and link to it in the normal fashion. If you optimize it =
            properly, it
            can get you significant traffic and sales. There are even two modules =
            that
            will do this for you. I went to that link you gave and all it =
            discusses is
            disallowing robots from indexing directories with the robots.txt file =
            and
            nothing more.

            Jason
            JMH Web Services, Inc.
            <A HREF ="http://www.jmhonline.net">http://www.jmhonline.net</A>
            Miva Merchant Development and Search Engine Optimization
            <A HREF ="http://www.jmhonline.net/searchmiva">http://www.jmhonline.net/searchmiva</A>


            Actually....,

            You can make great use of robot files if you know how to used them
            effeciently. For example:

            You can create a page that has nothing but a list of links that goes to
            every single product page in your miva store. Not a very pretty page =
            and one
            you would not want most customers to see, but using a robat file, you =
            could
            have the robot go to this page and follow all links from this page, but =
            not
            index this link page. The results is that when your site is indexed, =
            all
            your product detail pages are indexed, but this page is excluded so =
            that
            people would not normally find this page unless they knew it was there.

            here is a great link that provides example uses of robot files and is =
            one fo
            the greatest sites for SEO information.

            http://spider-food.net/handling-robots.html

            Hope that helps. :0)

            Rich




            -----Original Message-----
            From: Jason Henderson [mailto:[email protected]]
            Sent: Tuesday, June 10, 2003 2:13 PM
            To: Robert Jober; [email protected]
            Subject: Re: [mru] What about robots.txt


            Won't help at all. robots.txt file is mainly for excluding pages =
            and/or
            certain directories.

            Jason
            JMH Web Services, Inc.
            <A HREF ="http://www.jmhonline.net">http://www.jmhonline.net</A>
            Miva Merchant Development and Search Engine Optimization
            <A HREF ="http://www.jmhonline.net/searchmiva">http://www.jmhonline.net/searchmiva</A>


            > Does setting up robots.txt file can help in getting miva product =
            pages
            into
            > search engines.
            >
            > I have small number of products in my miva shop and could even link =
            to
            > single page.
            >
            > robert
            >
            > P.S. - doesn any of you have example robots.txt file that works with =
            miwa.


            Comment


              #7
              What about robots.txt



              Thx Richard!

              For a really helpful answer.

              robert

              -----Original Message-----
              From: Richard Chatfield [mailto:[email protected]]
              Sent: Wednesday, June 11, 2003 3:00 AM
              To: Jason Henderson; Robert Jober; [email protected]

              Yeah yeah your right lol

              Crossing wires here sry. The file prevents indexing of pages and dir, the
              robo meta tag is what I meant. Sry for the confusion. Thanks for the
              correct.

              Rich

              THANK YOU SIR MAY I HAVE ANOTHER :0)


              -----Original Message-----
              From: Jason Henderson [mailto:[email protected]]
              Sent: Tuesday, June 10, 2003 3:24 PM
              To: Richard Chatfield; Robert Jober; [email protected]
              Subject: Re: [mru] What about robots.txt


              Richard,

              What do you mean by robot files? There is robot.txt which is one file and
              robot meta tags. It sounds like your are talking about a robot meta tag
              that will tell robots to not index the page but follow the links.<meta
              name="robots" content="noindex,follow"> Why not just make a pretty sitemap
              page and link to it in the normal fashion. If you optimize it properly, it
              can get you significant traffic and sales. There are even two modules that
              will do this for you. I went to that link you gave and all it discusses is
              disallowing robots from indexing directories with the robots.txt file and
              nothing more.

              Jason
              JMH Web Services, Inc.
              <A HREF ="http://www.jmhonline.net">http://www.jmhonline.net</A>
              Miva Merchant Development and Search Engine Optimization
              <A HREF ="http://www.jmhonline.net/searchmiva">http://www.jmhonline.net/searchmiva</A>


              Actually....,

              You can make great use of robot files if you know how to used them
              effeciently. For example:

              You can create a page that has nothing but a list of links that goes to
              every single product page in your miva store. Not a very pretty page and one
              you would not want most customers to see, but using a robat file, you could
              have the robot go to this page and follow all links from this page, but not
              index this link page. The results is that when your site is indexed, all
              your product detail pages are indexed, but this page is excluded so that
              people would not normally find this page unless they knew it was there.

              here is a great link that provides example uses of robot files and is one fo
              the greatest sites for SEO information.

              http://spider-food.net/handling-robots.html

              Hope that helps. :0)

              Rich




              -----Original Message-----
              From: Jason Henderson [mailto:[email protected]]
              Sent: Tuesday, June 10, 2003 2:13 PM
              To: Robert Jober; [email protected]
              Subject: Re: [mru] What about robots.txt


              Won't help at all. robots.txt file is mainly for excluding pages and/or
              certain directories.

              Jason
              JMH Web Services, Inc.
              <A HREF ="http://www.jmhonline.net">http://www.jmhonline.net</A>
              Miva Merchant Development and Search Engine Optimization
              <A HREF ="http://www.jmhonline.net/searchmiva">http://www.jmhonline.net/searchmiva</A>


              > Does setting up robots.txt file can help in getting miva product pages
              into
              > search engines.
              >
              > I have small number of products in my miva shop and could even link to
              > single page.
              >
              > robert
              >
              > P.S. - doesn any of you have example robots.txt file that works with miwa.


              Comment

              Working...
              X