Tech TLDR;

  • Archive
  • Top Posts
  • GitHub
  • LinkedIn
  • Contact

Group Log Data by Timestamp in Python with Pandas

December 23, 2018 by admin

I often find myself with logs in the following format, exported in CSV. First column is timestamp in milliseconds, second column is timing for some request, also in milliseconds. Often I’d like to see the min, max and average request time, group by day and hour. Here is how to get this insight using Pandas […]

Filed Under: data, Python

Analyzing 200,000 Deleted Tweets with Spark, 40 Billion Comparisons

October 21, 2018 by admin

My wife and I were watching Jack Ryan, where John Krasinski is playing an FBI analyst. I wanted to be like him, so I began to look for things to analyze. In the past I’ve done text analysis for comments left on Mark Zuckerbergs Facebook post, which I described in I Tried To Virtually Stalk […]

Filed Under: data

Crunching Honeypot IP Data with Pandas and Python

April 7, 2018 by admin

I am taking a cyber security class. This week’s assignment had us work on Honeypots. Honeypot is a server that pretends to have a vulnerability of sorts (open ports, old software etc.) and instead collects data on people who are trying to hack it. At the end of the experiment I ended up with some […]

Filed Under: data, Python

Network Analysis of Donald Trump’s Tweets for 2017

August 2, 2017 by admin

A year and a half ago I Tried To Virtually Stalk Mark Zuckerberg. It was a failed attempted and instead I analyzed comments on one of Mark’s posts. Few days ago I came across a repo/archive of Donald Trump’s Tweets and I thought it would be interesting to run a similar analysis on this data. […]

Filed Under: data

AI is the New Electricity – Andrew Ng – Transcript

June 16, 2017 by admin

If you don’t yet know who Andrew Ng is, he is the Founder and Lead of Google Brain (Deep Learning) project, Adjunct Professor of Computer Science at Stanford University, Co-Founder of Coursera and author of one of the best (if not the best) Machine Learning courses. In other words he is to AI, what Justin […]

Filed Under: data, Machine Learning

I Tried To Virtually Stalk Mark Zuckerberg

April 4, 2016 by admin

Part 1. A Naive Dream The Dream In late 2015, I finished reading Automate the Boring Stuff with Python and was very inspired to try to automate something in my life. At the same time, I have been always fascinated by Mark Zuckerberg – the Bill Gates of our time. A lot of people love […]

Filed Under: data

Copyright © 2023 · eleven40 Pro Theme on Genesis Framework · WordPress · Log in