Tutorial Seek Development Blog

IB Personal Project of Jamie Chung

 

First Journal Check - TOMOROW!

So during Lunch today, I went to Mr. Desmond’s class to get a new pink ( salmon ) form for my project since I changed my project since. I need to fill it out and get it back to him tomorow when I do see him. Just a precaution, I asked him if it was okay to do all of my project online ( even the process journal in the form of a blog ) and he said it as all okay! So I am glad that I got some sort of approval from doing this project so far.

I was doing some Research this afternoon since today was an early release day at school. I was brain-storming for ways of how the spider was going to work so I can apply that same logic to my coding and programming to put the whole thing together and make it a reality. I looked up what the google bot’s user agent was and made my own user agent from that to test with. It worked! I am now able to tell sites when the spider is visiting and crawling their website, in which they can check in their statistic logs to see when they do get crawled and how often and other usefull information that need. Using the useragent tutorialseek, users can identify when the TS Bot does infact crawl their websites. I tested this by sending a fake crawler to a forum in which I can manage the spider’s Human Name. In fact it worked and it showed the bot as Tutorial Seek visiting the site as a spider bot. So as of now, it is a success!

Later tomorow afternoon I will be arraging some database structures for the spider and site to work with. Keeping in mind that the users will submit sites on a whole for the spider to crawl will be the most important - so a method where I can link tutorials hosted on that specific site with a source site that is given is necessary and such and such.

Tomorow starts the first of many journal checks. I am lucky that I got my domain name this week for this project so I could start this project and get it off the ground. Thats it for now.

Filed under : General, Personal Project, Development
By Jamie
On August 24, 2006
At 8:22 pm
Comments :
 

2 Comments for this post

 
cheerio Says:

You’re always raising the bar. Always trying new things and succeeding so quickly. I envy you!
Good luck with this, sounds like it will be EXTREME.

 
 
Dylan Andrews Says:

Good luck man, I hope you go fa with this and I’ll be with ya the whole way watching and seeing whats happening. Think maybe we can get like a list of pages? You know like what types of pages will it have and will it have the user dock you made on p2l, will it have forums etc?

 

Leave a Reply

 
PageRank Plus - Google PageRank checking, with a twist.