|
Hi, i want to get the list all how many web sites are using a Particular link such as www.yahoo.com. Example as we see this example at google. when type www.yahoo.com then press search then it gives a list of url how many websites are using this link. i want that list who are using website www.yahoo.com please any one have any idea to do that. Thanks John |
| JohnAbraham Thursday, August 27, 2009 9:15 PM |
Build a website crawler and spread it over the web. Build a database and there's you get it ! no, really.. i am not kidding.. thats the way to do it !
Thanks â™? My Blog â™? My Flickr â™? My Facebook â™?/div> - Marked As Answer byKira QianMSFT, ModeratorThursday, September 03, 2009 8:03 AM
-
|
| Omie Thursday, August 27, 2009 9:34 PM |
Hi JohnAbraham, Based on my understanding, you want to know how many web site has put a link refer to www.yahoo.com. That seems the technology of Google Page Rank. http://en.wikipedia.org/wiki/PageRank Google store all the web page in the database and count the refer of each page. The most referred URL will be sort at the top of your search result. That is some kind of what you want. How to make a search engine is beyond the support of this forum. If I misunderstood you, please feel free to tell me. Sincerely, Kira Qian Please mark the replies as answers if they help and unmark if they don't.- Marked As Answer byKira QianMSFT, ModeratorThursday, September 03, 2009 8:03 AM
-
|
| Kira Qian Monday, August 31, 2009 6:29 AM |
Build a website crawler and spread it over the web. Build a database and there's you get it ! no, really.. i am not kidding.. thats the way to do it !
Thanks â™? My Blog â™? My Flickr â™? My Facebook â™?/div> - Marked As Answer byKira QianMSFT, ModeratorThursday, September 03, 2009 8:03 AM
-
|
| Omie Thursday, August 27, 2009 9:34 PM |
Hi, Thanks for reply, But i could not understand about crawler. can you please elaborate little bit more. provide few step how can i do this in asp.net or winforms using c# how can i do it using c# winforms or ASP.NET C# Thanks John |
| JohnAbraham Sunday, August 30, 2009 5:41 AM |
crawler means making a program that will scan each and every page of a website for links, identify them and add in database, pretty tough job it is :P see google webmaster tools. They provide such services. Technorati.com does it for blogs.
Thanks â™? My Blog â™? My Flickr â™? My Facebook â™?/div> |
| Omie Sunday, August 30, 2009 6:41 AM |
|
| Omie Sunday, August 30, 2009 6:44 AM |
Hi, Thanks for reply and giving valuable information to me. Actually, i have not done this kind of stuff. so i am little bit confusion. my requirement, i want to the list in sqlserver data base of all those link and sub link of particular url . now i am going to try how i can do this crawler tool using winform c# Thanks John |
| JohnAbraham Sunday, August 30, 2009 8:01 AM |
Hi JohnAbraham, Based on my understanding, you want to know how many web site has put a link refer to www.yahoo.com. That seems the technology of Google Page Rank. http://en.wikipedia.org/wiki/PageRank Google store all the web page in the database and count the refer of each page. The most referred URL will be sort at the top of your search result. That is some kind of what you want. How to make a search engine is beyond the support of this forum. If I misunderstood you, please feel free to tell me. Sincerely, Kira Qian Please mark the replies as answers if they help and unmark if they don't.- Marked As Answer byKira QianMSFT, ModeratorThursday, September 03, 2009 8:03 AM
-
|
| Kira Qian Monday, August 31, 2009 6:29 AM |