Happy new year everybody!
Everyone knows Google, right? They have a huge data-center that stores all website around the world. How can they do it? With a bot spider! Very intelligent spider. And we gonna made it, but simpler, and for our own purpose.
We don't have to defeat Google or competitive with them, we just learn from them to create ours.
For my reason, I want to create a bot, a spider or a crawler that can help me collect all articles from some e-news websites, some blogs, and from Google caches (for website is dead). Cut out the content and put it in my database (for my website, for my other activities, etc).
I hope you come her with same purpose as me, or have the same attitude to learn how crawler work. I'm really want to share and learn about new thing with other people. And I'm always open for your contribute, your comment and feedback to improve other skill.
Feel free to join group, feel free to prove me wrong (both coding and English). And I'm welcome you to be co-founder of this group too.
P/S: I'm new to python, so I don't know much, but I will try to post 1 tutorial per week around topic crawler and scrapping.
A few worlds about myself:
I'm Thang, a web developer and designer (*I can use photoshop and html/css too*), and I'm 24 y/o (*so you can call me bro, dude, noob if you want*). I used to work as freelancer, now I'm build e-com website for my friend. And I will find a new job on June, this year.
Haha no way... My very first SETT post was about writing a scraper in perl and using wGet. Small world, although it's probably more likely that the people who read Tynan's blog and thus are likely to use SETT are all very similar... Data mining
So back in January, I wrote out my 7 goals for the year. It's been two months, so let's see how I'm doing :
1. Become FULLY polyphasic
I'm close on this one. Many days I go perfectly, sometimes if I have nothing to do I oversleep and then skip some naps during the day. I'm actually pretty satisfied with that, as I'm only sleeping 2.5-4.5 hours per night, I'm never tired, and can always count on being awake early and staying up late. I'll keep pressing to be more consistent, but I'm satisfied with where I am.
Oh, yes. I am supposed to say "hello and welcome". So, Hi.
The first thing I would like to say it's that I'm a native Spanish speaker, so if I get lost in translation even when I'm writing English, don't judge me so bad.
The second thing I would like you to know, it is the main purpose of this blog. I found pretty interesting how desperate we found ourselves when we are learning a new language. Specially if you moved to a new country and you really don't know how to ask for help. I don't remember myself when I first learned English, perhaps because I was pretty young, but in French it is just driving me crazy.
So, I read that if you write short stories in the language you want to learn, and people help you to correct it and to improve your vocabulary, your grammar and everything concerned to the language, you might learn faster than you think. Basically, this blog has the purpose to improve my French language (though I accept corrections on my English too), so you will find probably reading a few short stories on French (which will be translated later to English) and I would love if anyone could help to write them correctly.
That's the way I found to get out of this language "black hole" (Oh, I must say, my major is on Physics, so that's why you will find a lot of idioms with those things).