A1VBCode Forums

Building a search engine from scratch


http://a1vbcode.com/vbforums/Topic29290.aspx

By chsus - 5/16/2010



Hi All,



I am a rookie to the web programming domain. I only have some basic scientific programming skills (read: writing simple if-else and for loop programs). I wanted to embark on programming a web search engine from scratch. I figured it would not only help me improve my programming skills but will also give me something tangible to evaluate my progress.



I was wondering if any of you could give me pointers to the right resources. I looked up amazon for books on "search engine programming" and got nothing. Obviously I am doing something completely wrong. If you could point out a website or a book or anything of that sort where I could go from scratch.



I have working knowledge of python, perl, C++ and Java.



thanks,

Sandeep.


By samcom - 5/17/2010

Its a bit complicated architecture. Search engines basically works on crawling the websites, acquiring, sorting and storing the information and snapshots about websites in its database. mostly u should learn more on internet protocols then how to access websites from your application. if you are using visual basic to do this, winsock will be your friend. for example; for google to work properly, your site must some kind of sitemap, keywords and correct structure....good luck though