Happy new year everybody!
Everyone knows Google, right? They have a huge data-center that stores all website around the world. How can they do it? With a bot spider! Very intelligent spider. And we gonna made it, but simpler, and for our own purpose.
We don't have to defeat Google or competitive with them, we just learn from them to create ours.
For my reason, I want to create a bot, a spider or a crawler that can help me collect all articles from some e-news websites, some blogs, and from Google caches (for website is dead). Cut out the content and put it in my database (for my website, for my other activities, etc).
I hope you come her with same purpose as me, or have the same attitude to learn how crawler work. I'm really want to share and learn about new thing with other people. And I'm always open for your contribute, your comment and feedback to improve other skill.
Feel free to join group, feel free to prove me wrong (both coding and English). And I'm welcome you to be co-founder of this group too.
P/S: I'm new to python, so I don't know much, but I will try to post 1 tutorial per week around topic crawler and scrapping.
A few worlds about myself:
I'm Thang, a web developer and designer (*I can use photoshop and html/css too*), and I'm 24 y/o (*so you can call me bro, dude, noob if you want*). I used to work as freelancer, now I'm build e-com website for my friend. And I will find a new job on June, this year.
Haha no way... My very first SETT post was about writing a scraper in perl and using wGet. Small world, although it's probably more likely that the people who read Tynan's blog and thus are likely to use SETT are all very similar... Data mining
So back in January, I wrote out my 7 goals for the year. It's been two months, so let's see how I'm doing :
1. Become FULLY polyphasic
I'm close on this one. Many days I go perfectly, sometimes if I have nothing to do I oversleep and then skip some naps during the day. I'm actually pretty satisfied with that, as I'm only sleeping 2.5-4.5 hours per night, I'm never tired, and can always count on being awake early and staying up late. I'll keep pressing to be more consistent, but I'm satisfied with where I am.
If anyone else is like me, they have more than one 'version' of themselves and each one serves almost a different purpose. For example, I'm the happy, confident and generally carefree me in front of my friends and mostly my family, however, with a certain group of my friends, the closer ones to me the people I actually trust, I also show them the me when I'm down and vulnerable. And of course with my lover I show him all of me, when I'm happy and carefree as well as when Im troubled or depressed ^ ^
So that's images - what other people show us and what we choose to show other people. Next is masks. Basically the same but with more of a 'hiding' element to it. So for example, a few days back I was feeling super depressed, really sick of life and I was only online to try and distract myself from my suicidal thoughts when a friend began talking to me. Talking to him, I had to act completely normal, which to be honest can be pretty tiring especially when I was already feeling so exhausted mentally to begin with.
Wearing masks in front of people has become basically second nature to me and I do it naturally like everyone else, to hide my weaknesses from other people. Not only my friends but my family, pretending I'm ok even when inside I'm torn apart. Now don't get me wrong, I'm not playing it like I'm the only person on earth who does this, I have to yet to find someone who doesn't, but I just want some more opinions on this and maybe some clarification as to why I don't feel like I can trust my family?
Also, I'm really selfish. Even when I hide my pain from other people, I sort of still expect them to notice I'm not ok, really selfish I know and basically seeking attention but sometimes I think we all need that- someone who can understand how youre feeling without you telling them. My boyfriend always somehow seems to be able to tell that I'm feeling depressed sometimes even before I notice which is pretty crazy but also rather nice; knowing theres someone out there you don't have to act in front of, who loves you and understands you and knows you as well as you know yourself ^ ^
Next is 'worlds', not literal worlds hence why its in quotation marks. Like many people, I keep my personal and family life apart. Yes I call it personal not social simply cuz I find that I 'socialize' with people I don't trust and include my friends as part of 'personal' since these are the people I trust.