Commit Graph

  • 3643800f8e [O] Process only if not processed Hykilpikonna 2021-11-22 14:31:14 -05:00
  • 6995481d0e [+] Process tweets in main Hykilpikonna 2021-11-22 14:28:47 -05:00
  • d16032aa71 [+] Process tweets Hykilpikonna 2021-11-22 14:28:36 -05:00
  • 0dc0688273 [F] Fix unauthorized Hykilpikonna 2021-11-22 14:24:22 -05:00
  • acfb397c9c [+] Create function to check if a post is covid-related Hykilpikonna 2021-11-22 14:11:02 -05:00
  • 9e27a3c725 [O] Use write function in data processing Hykilpikonna 2021-11-22 14:00:28 -05:00
  • a73a792189 [O] Optimize imports Hykilpikonna 2021-11-22 13:59:55 -05:00
  • 4c83dd07a2 [O] Use read and write functions Hykilpikonna 2021-11-22 13:55:18 -05:00
  • 343e432df9 [+] Create helper functions for reading and writing files Hykilpikonna 2021-11-22 13:55:03 -05:00
  • 0186aa185f [+] Step C2 of data collection Hykilpikonna 2021-11-22 12:36:20 -05:00
  • eacbe6b488 [+] Check exists Hykilpikonna 2021-11-22 12:35:11 -05:00
  • a6ac2f15ed [O] Optimize debug messages Hykilpikonna 2021-11-22 12:30:39 -05:00
  • 05c10bf19a [-] Remove custom tweet model, optimize imports Hykilpikonna 2021-11-22 12:27:28 -05:00
  • b5c02ef702 [+] Implement download all tweets Hykilpikonna 2021-11-22 12:20:14 -05:00
  • 4099b2d4fd [O] Make rate limit static Hykilpikonna 2021-11-22 11:51:28 -05:00
  • a95374302a [+] Create main Hykilpikonna 2021-11-22 11:33:08 -05:00
  • 12327d6aab [O] Use named tuple instead of data class Hykilpikonna 2021-11-22 11:32:58 -05:00
  • 14d3d84ed8 [F] Fix more pyta warnings Hykilpikonna 2021-11-22 10:57:25 -05:00
  • 8049a3604d [F] Fix name shadowing Hykilpikonna 2021-11-22 10:49:37 -05:00
  • 29270cff70 [F] Fix pyta errors Hykilpikonna 2021-11-22 10:48:00 -05:00
  • b3271a5c72 [+] Add python-ta in requirements Hykilpikonna 2021-11-22 10:43:23 -05:00
  • 44831c6b30 [+] Add caller info to debug Hykilpikonna 2021-11-22 10:36:26 -05:00
  • 46b8f80b70 [F] Fix load_users_popularity Hykilpikonna 2021-11-22 10:31:47 -05:00
  • 38c7a71860 [F] Fix imports Hykilpikonna 2021-11-22 10:24:43 -05:00
  • 68d61757f6 [O] Use generalusers class Hykilpikonna 2021-11-22 10:20:37 -05:00
  • 01235a003c [+] Create function to load users by popularity Hykilpikonna 2021-11-22 10:19:25 -05:00
  • d60d74def5 [O] Separate normalize_directory function Hykilpikonna 2021-11-22 10:14:56 -05:00
  • 77e0176dbc [M] Move data classes from utils to twitter_process Hykilpikonna 2021-11-22 10:09:03 -05:00
  • 991fef7e13 [+] Add twitter user data descripition Hykilpikonna 2021-11-22 09:56:29 -05:00
  • 7c421730df [+] Create project report Hykilpikonna 2021-11-22 09:48:35 -05:00
  • 5220b9e2a1 [M] Move proposal to writing folder Hykilpikonna 2021-11-22 09:30:15 -05:00
  • e4b8bc3b20 [F] Fix imports Hykilpikonna 2021-11-22 09:27:27 -05:00
  • a7acdf9062 [O] Reformat docstring Hykilpikonna 2021-11-22 09:27:06 -05:00
  • 028003e838 [+] Add comments in requirements Hykilpikonna 2021-11-22 09:14:10 -05:00
  • 7e19250fe9 [O] Handle too many requests exception Hykilpikonna 2021-11-22 00:36:33 -05:00
  • b55b4f3e4c Revert "[-] Remove testing script" Hykilpikonna 2021-11-22 00:24:56 -05:00
  • 459e1c6912 [+] Display requests per minute Hykilpikonna 2021-11-22 00:24:12 -05:00
  • 794008b182 [O] Make indent customizable Hykilpikonna 2021-11-22 00:12:22 -05:00
  • 248ce6c7c8 [O] Use dumps for meta Hykilpikonna 2021-11-22 00:07:57 -05:00
  • f0286e0b13 [O] Print metainfo Hykilpikonna 2021-11-22 00:05:25 -05:00
  • 428ead35ef [O] Implement resume Hykilpikonna 2021-11-21 23:53:16 -05:00
  • 51366074bf [O] Separate resume function Hykilpikonna 2021-11-21 23:44:22 -05:00
  • b2edfc2003 [O] Move rate delay to the end Hykilpikonna 2021-11-21 23:34:22 -05:00
  • cbff127611 [-] Remove protected users Hykilpikonna 2021-11-21 23:34:10 -05:00
  • 053e7ad503 [F] Oops, the rate limit is 15 per 15 minutes, not 15 per minute Hykilpikonna 2021-11-21 23:32:19 -05:00
  • b4ca5f65af [F] Fix rate limit Hykilpikonna 2021-11-21 23:22:34 -05:00
  • ad3868406b [F] Fix "TypeError: unhashable type: 'set'" Hykilpikonna 2021-11-21 23:20:40 -05:00
  • 5e2f0b7234 [O] Use json.stringify instead of json.dumps Hykilpikonna 2021-11-21 23:18:42 -05:00
  • 236b1a352c [+] Mark src directroy Hykilpikonna 2021-11-21 23:17:45 -05:00
  • e95253d5ca [+] Ignore data files Hykilpikonna 2021-11-21 23:17:35 -05:00
  • 23cbab046c [+] Support stringify sets Hykilpikonna 2021-11-21 23:15:54 -05:00
  • f81643aca5 [F] mkdirs Hykilpikonna 2021-11-21 23:13:29 -05:00
  • e59ba314d0 [F] Fix rate limit Hykilpikonna 2021-11-21 23:10:49 -05:00
  • 963256ce16 [-] Remove testing script Hykilpikonna 2021-11-21 23:09:34 -05:00
  • 032c7caffd [U] Update requirements Hykilpikonna 2021-11-21 23:09:10 -05:00
  • 30aee55a7d [O] Make config path confiugrable Hykilpikonna 2021-11-21 23:07:13 -05:00
  • b3e7e3ee38 [F] Fix imports Hykilpikonna 2021-11-21 23:05:38 -05:00
  • 2be16d2dfb [+] Forgot to add api as a param Hykilpikonna 2021-11-21 23:05:06 -05:00
  • f1a4c95fae [-] Remove get_user_following_data Hykilpikonna 2021-11-21 23:03:49 -05:00
  • 44ef88c420 [+] Implement rate limit Hykilpikonna 2021-11-21 23:03:10 -05:00
  • 181a89688b [+] Write meta info Hykilpikonna 2021-11-21 22:52:33 -05:00
  • 30a78e6b0e [+] Implement friends-chain Hykilpikonna 2021-11-21 22:46:25 -05:00
  • f3760f6c6b [+] Create download_users function signature Hykilpikonna 2021-11-21 22:13:16 -05:00
  • 907b464d3f [M] Move code to src Hykilpikonna 2021-11-21 22:03:12 -05:00
  • c5b0aba8cf [M] Change the folder name collect to raw_collect Hykilpikonna 2021-11-21 22:02:37 -05:00
  • ba7fb3919b [O] Allow non-ascii in json Hykilpikonna 2021-11-21 21:34:43 -05:00
  • 523dc813a5 [U] Update bib Hykilpikonna 2021-11-05 00:57:29 -04:00
  • 2a88ff8bf7 [+] Add some ambitious goals Hykilpikonna 2021-11-05 00:42:22 -04:00
  • 91ca53147c [+] Add voxdotcom sample data Hykilpikonna 2021-11-05 00:42:12 -04:00
  • 68985c67fb [F] Correctly fix repost detection Hykilpikonna 2021-11-05 00:23:08 -04:00
  • 4ff72a47d7 [O] Optimize network usage by trimming username Hykilpikonna 2021-11-05 00:19:52 -04:00
  • 7868b1ac07 [F] Fix retweet detection Hykilpikonna 2021-11-05 00:19:24 -04:00
  • 6383605491 [+] Convert tweets to generic format Hykilpikonna 2021-11-05 00:15:46 -04:00
  • 0751324fd6 [+] Create json encoder that supports dataclasses and datetime Hykilpikonna 2021-11-05 00:15:31 -04:00
  • 39559bbf3a [-] Ignore config file Hykilpikonna 2021-11-04 23:53:59 -04:00
  • 407a20abd7 [+] Add more ignores Hykilpikonna 2021-11-04 23:48:29 -04:00
  • 7c81ac1365 Create references.bib MstrPikachu 2021-11-04 21:55:31 -04:00
  • d766732d9b Add references to project_proposal.tex MstrPikachu 2021-11-04 21:54:41 -04:00
  • 059ddcbb1b [+] Italic and bold Hykilpikonna 2021-11-03 19:14:40 -04:00
  • f059764c8a [S] Indent after section Hykilpikonna 2021-11-03 19:10:50 -04:00
  • b7e53748f7 [+] Ignore latex intermediate files Hykilpikonna 2021-11-03 19:10:33 -04:00
  • 9cc7fd8968 [+] Draft Hykilpikonna 2021-11-03 19:09:11 -04:00
  • 0cc1583908 [+] Add project proposal Hykilpikonna 2021-11-03 19:00:45 -04:00
  • 3e74ee84b1 [+] Test download tweets Hykilpikonna 2021-11-03 18:59:28 -04:00
  • 2086c5199d [+] Download tweets function Hykilpikonna 2021-11-03 18:59:15 -04:00
  • dcb912fae1 [F] Fix max_id Hykilpikonna 2021-11-03 16:51:39 -04:00
  • 880805c1ff [+] Add date param to posting class Hykilpikonna 2021-11-03 16:47:08 -04:00
  • 78a2b91b9d [O] Optimize imports Hykilpikonna 2021-11-03 16:46:29 -04:00
  • 5a42bded0f [+] Create debug function Hykilpikonna 2021-11-03 16:45:54 -04:00
  • 879aa3e5ef [+] Create platform-independent user and posting classes Hykilpikonna 2021-11-03 16:45:46 -04:00
  • 37bbe4f5b0 [+] Get all tweets from a specific user in a loop Hykilpikonna 2021-11-03 16:45:30 -04:00
  • ae885317a1 [+] Create function to get user tweets Hykilpikonna 2021-11-03 16:33:54 -04:00
  • 05e511c743 [+] Create user and tweet dataclasses Hykilpikonna 2021-11-03 16:22:20 -04:00
  • af203e4c2f [+] Create separate twitter file Hykilpikonna 2021-11-03 16:22:07 -04:00
  • 1af5182f91 [+] Get tweets from inidivdual Hykilpikonna 2021-11-03 16:00:05 -04:00
  • 00be8d7d40 [U] Update usage in tweepy login Hykilpikonna 2021-11-03 15:59:44 -04:00
  • 9ff31adbcd [+] Parse config data class Hykilpikonna 2021-11-03 15:59:31 -04:00
  • 53fe18049b [+] Create config data class Hykilpikonna 2021-11-03 15:59:19 -04:00
  • db6c5328ca [+] Create function for tweepy login Hykilpikonna 2021-11-03 15:42:18 -04:00
  • 102cad055e [M] Move create_config to a separate file Hykilpikonna 2021-11-03 15:36:42 -04:00