Feat: Derive the List of Companies Using Code we have Written

[nelsonic]

While it's not possible to see Who has downloaded/used our repos from NPM or Hex.pm we can establish a reasonable proxy simply by seeing Who has starred our various repos and then extracting their Company info from their GitHub profile. This is a task I've been meaning to do for years and would really like to have done.

It may appear to be a "vanity metric" on the surface, but I intend to use it on our Website as a "Social Proof".

Todo

• Define the schema for profile Feat: Create (GitHub) profile schema to store public profile data #85
• Use both scraping and the GitHub API to create a database of the people who have starred, watched or contributed to our repos on GitHub List repository contributors #20
• Once the profile data for all the people ("users") has been populated into the DB,
  we can easily select the company field and see the list of companies those people work for.

[nelsonic]

Going to take a look at this one tomorrow morning. 🌅

First need to ingest a bunch more Orgs ... Currently only have 358 on localhost:

Going to try and write a proxy query to help get to the data I want ... 🔍

[nelsonic]

Let's start by selecting all the people (users) who have a company field defined.

SELECT DISTINCT company, login, name
FROM users
WHERE company IS NOT NULL

I find it strange that so few people bother putting their company on their GitHub Profile ... 🤷‍♂

With 182 thousand users I'd expect a lot more. 💭

[nelsonic]

A few more rows today:

SELECT DISTINCT company, followers, login, name
FROM users
WHERE company IS NOT NULL
ORDER BY followers DESC

But sadly, many people have these long (multi-word) names or job titles in their company field
so we cannot simply join the org ...
It's going to be a manual data-cleansing job. ⏳ 😕
But at least we have a starting point for the data. ⏭