I believe that people who comments on Youtube videos, good or bad, provide a solid, measurable way to understand content. Social media data mining may or may not be a bullshit thing to study but I think if the results (especially ones on either extremes) make sense and pass the ‘eye test’, it’s probably something worth exploring further. One thing I think makes sense to look at, especially for videos from ‘street’ rappers, is to see if the people commenting type in some sort of unique, measurable way.
Ebonics is a rule-governed language that can sometimes be studied on paper. For example, something like G-Dropping can be looked at on text. Another rule of ‘Ebonics’ has to do with word-initial fricatives. This is a fancy way to say that words like {This} get pronounced {dis} in spoken language. And sometimes, because this is an example where the spelling of the word goes with the general rules of sound and stuff, people will actually write {dis}.
We can go to the Youtube videos of several artists and look at the distribution of [This,The] with [dis, da]. It turns out, of course, that it’s an excellent way to separate, on extreme ends, different styles and fanbases. Fans of Pastor Troy speak way differently than Atmosphere fans.
| Artist | /d/ | /th/ | Ratio |
|---|---|---|---|
| Soulja Slim | 15.52 | 98.71 | 6.36 |
| Playa Fly | 17.1 | 108.89 | 6.37 |
| Guerilla Maab | 12.59 | 103.9 | 8.25 |
| Beanie Sigel | 10.68 | 88.97 | 8.33 |
| E.S.G. | 10.68 | 88.97 | 8.33 |
| Pastor Troy | 11.99 | 110.9 | 9.25 |
| Yo Gotti | 8.26 | 90.62 | 10.97 |
| Kane & Abel | 11.24 | 126.63 | 11.26 |
| Eightball & MJG | 9.37 | 112.73 | 12.03 |
| Koopsta Knicca | 8.62 | 104.44 | 12.12 |
| South Park Mexican | 7.05 | 87.76 | 12.44 |
| Gangsta Boo | 6.51 | 82.6 | 12.68 |
| Mia X | 8.03 | 106.84 | 13.31 |
| Tela | 8.33 | 111.46 | 13.38 |
| Gangsta Pat | 8.66 | 123.28 | 14.24 |
| TRU | 8.05 | 115.56 | 14.35 |
| Hot Boys | 6.93 | 103.08 | 14.88 |
| Jayo Felony | 6.83 | 105.24 | 15.42 |
| Yung Joc | 6.09 | 94.88 | 15.58 |
| Master P | 5.99 | 98.55 | 16.46 |
| Gucci Mane | 5.16 | 86.9 | 16.85 |
| E-40 | 4.21 | 83.94 | 19.93 |
| Bun B | 4.87 | 97.98 | 20.1 |
| Chief Kamachi | 6.74 | 138.2 | 20.5 |
| Kam | 6.74 | 138.2 | 20.5 |
| U.G.K. | 4.73 | 97 | 20.5 |
| Lil Flip | 4.83 | 104.09 | 21.56 |
| C-Bo | 5.07 | 109.73 | 21.63 |
| Project Pat | 4.5 | 97.81 | 21.75 |
| Foxy Brown | 4.92 | 108.07 | 21.96 |
| Memphis Bleek | 4.53 | 104.66 | 23.1 |
| Conejo | 4.8 | 112.4 | 23.42 |
| Waka Flocka | 3.8 | 90.14 | 23.73 |
| Skillz | 4.15 | 101.54 | 24.48 |
| Suga Free | 3.7 | 91.58 | 24.73 |
| Spice 1 | 4.64 | 117.75 | 25.39 |
| Boot Camp Clik | 3.72 | 95.01 | 25.51 |
| Joell Ortiz | 4.04 | 103.34 | 25.61 |
| Brotha Lynch Hung | 4.11 | 106.04 | 25.78 |
| MC Eiht | 3.62 | 93.66 | 25.9 |
| Poison Clan | 5.91 | 153.18 | 25.92 |
| Ganksta NIP | 5.25 | 138.69 | 26.44 |
| Mike Jones | 3.3 | 87.23 | 26.47 |
| Future | 3.96 | 105.34 | 26.61 |
| Flesh-N-Bone | 4.65 | 123.87 | 26.67 |
| Timbo King | 5.71 | 157.14 | 27.5 |
| Young Jeezy | 3.77 | 109.12 | 28.94 |
| Half-A-Mill | 4.6 | 138.49 | 30.09 |
| Capone-N-Noreaga | 3.41 | 102.74 | 30.13 |
| NORE | 3.41 | 102.74 | 30.13 |
| Noreaga | 3.41 | 102.74 | 30.13 |
| Erick Sermon | 3.2 | 97.11 | 30.36 |
| IAM | 1.7 | 52.03 | 30.52 |
| Saul Williams | 1.7 | 52.03 | 30.52 |
| Canibus | 4.82 | 148.34 | 30.79 |
| The Click | 3.89 | 120.37 | 30.94 |
| Eve | 3.12 | 96.56 | 30.97 |
| Everlast | 3.12 | 96.56 | 30.97 |
| Lil Wyte | 3.27 | 102.06 | 31.2 |
| Black Moon | 4.1 | 130.86 | 31.91 |
| Bow Wow | 2.86 | 92.61 | 32.34 |
| Shyheim | 3.45 | 112.91 | 32.74 |
| Bizzy Bone | 3.05 | 99.91 | 32.8 |
| Juelz Santana | 3.1 | 102.17 | 33 |
| King Tee | 2.95 | 97.42 | 33 |
| Petey Pablo | 2.52 | 87.38 | 34.74 |
| Heltah Skeltah | 3.34 | 116.44 | 34.9 |
| Jim Jones | 2.89 | 102.02 | 35.34 |
| Soulja Boy | 2.66 | 94.85 | 35.71 |
| Lost Boyz | 3.09 | 112.08 | 36.23 |
| Pep Love | 3.19 | 117.37 | 36.75 |
| Juvenile | 3 | 110.86 | 36.97 |
| Keith Murray | 3.17 | 117.79 | 37.15 |
| Haystak | 3.17 | 118.86 | 37.45 |
| Cru | 3.64 | 138.41 | 38.06 |
| Crucial Conflict | 3.64 | 138.41 | 38.06 |
| Clipse | 2.97 | 114.8 | 38.62 |
| Clipse | 2.97 | 114.8 | 38.62 |
| Kris Kross | 2.52 | 100.16 | 39.67 |
| Gospel Gangstas | 3.72 | 150.37 | 40.4 |
| Chingy | 2.37 | 95.93 | 40.45 |
| Akinyele | 2.73 | 113.24 | 41.42 |
| N.W.A. | 2.63 | 109.47 | 41.6 |
| Styles P | 2.69 | 111.83 | 41.65 |
| Bone Thugs-N-Harmony | 2.68 | 111.95 | 41.74 |
| Hi-C | 2.66 | 111.93 | 42 |
| Planet Asia | 2.52 | 106.07 | 42.1 |
| Fabolous | 2.21 | 93.65 | 42.37 |
| MC Ren | 2.37 | 102.16 | 43.19 |
| Cormega | 2.81 | 122.3 | 43.48 |
| Control Machete | 1.01 | 44.39 | 43.94 |
| Rhymefest | 2.31 | 101.95 | 44.15 |
| Camp Lo | 2.98 | 132.8 | 44.53 |
| MC Lyte | 2.36 | 105.79 | 44.8 |
| camron | 2.49 | 112.12 | 45 |
| Above the Law | 2.21 | 100.36 | 45.48 |
| 50 Cent | 2.1 | 96.54 | 45.93 |
| Tony Yayo | 2.1 | 96.6 | 45.96 |
| G Unit | 2.2 | 102.09 | 46.35 |
| J-Live | 2.53 | 118.53 | 46.79 |
| Monie Love | 2.73 | 129.04 | 47.19 |
| Onyx | 2.05 | 97.86 | 47.68 |
| AMB | 2.31 | 110.5 | 47.8 |
| Scarface | 2.6 | 124.75 | 48.07 |
| Fu-Schnickens | 2.34 | 114.23 | 48.78 |
| Nappy Roots | 2.27 | 110.95 | 48.78 |
| MC Solaar | 1.42 | 70.55 | 49.6 |
| Group Home | 2.48 | 123.18 | 49.62 |
| Craig Mack | 2.33 | 116.43 | 49.98 |
| Casual | 2.41 | 121.69 | 50.5 |
| C-Rayz Walz | 1.95 | 99.02 | 50.67 |
| Chubb Rock | 2.26 | 115.47 | 51.15 |
| Krayzie Bone | 2.48 | 127.73 | 51.51 |
| Lil Kim | 2.38 | 124.48 | 52.33 |
| CL Smooth | 2.62 | 137.17 | 52.4 |
| Poor Righteous Teachers | 2.37 | 124.19 | 52.42 |
| Mase | 2.18 | 114.89 | 52.64 |
| Mase | 2.18 | 114.89 | 52.64 |
| Obie Trice | 2.31 | 121.79 | 52.68 |
| Sporty Thievz | 2.31 | 121.79 | 52.68 |
| T.I. | 2.31 | 121.79 | 52.68 |
| Trina | 2.31 | 121.79 | 52.68 |
| Twista | 2.31 | 121.79 | 52.68 |
| Ying Yang Twins | 2.31 | 121.79 | 52.68 |
| Psycho Realm | 1.44 | 76.62 | 53.25 |
| Slick Rick | 2.16 | 116.65 | 54.09 |
| MC Shan | 2.57 | 140.44 | 54.57 |
| Ice Cube | 1.73 | 94.96 | 54.76 |
| Masters of Illusion | 1.69 | 93.5 | 55.17 |
| AZ | 2.26 | 128.16 | 56.79 |
| Az the Visualiza | 2.26 | 128.16 | 56.79 |
| Bronze Nazareth | 2.26 | 128.16 | 56.79 |
| Eazy-E | 2.26 | 128.16 | 56.79 |
| Hell Razah | 2.26 | 128.16 | 56.79 |
| Sticky Fingaz | 2.26 | 128.16 | 56.79 |
| Fat Joe | 1.34 | 78.22 | 58.39 |
| O.C. | 2.36 | 138.25 | 58.47 |
| Pharoahe Monch | 2.36 | 138.25 | 58.47 |
| Sheek Louch | 2.36 | 138.25 | 58.47 |
| The Grouch | 2.36 | 138.25 | 58.47 |
| 9th Prince | 1.71 | 103.79 | 60.57 |
| Tyga | 1.72 | 106.29 | 61.81 |
| Nelly | 1.65 | 103.29 | 62.76 |
| Bubba Sparxxx | 1.41 | 89.69 | 63.47 |
| Ghostface Killah | 1.73 | 111.26 | 64.43 |
| Pigeon John | 1.69 | 110.42 | 65.47 |
| Mars ILL | 1.97 | 130.26 | 66 |
| Masta Killa | 1.79 | 119.43 | 66.81 |
| Biz Markie | 1.61 | 107.56 | 66.88 |
| BizMarkie | 1.61 | 107.59 | 66.9 |
| Afroman | 1.28 | 85.34 | 66.92 |
| Missy Elliott | 1.57 | 105.41 | 66.95 |
| Missy Elliott | 1.57 | 105.41 | 66.95 |
| Geto Boys | 1.68 | 113.8 | 67.68 |
| Pacewon | 2.03 | 137.53 | 67.79 |
| Young Money | 1.5 | 102.68 | 68.4 |
| Chamillionaire | 1.3 | 88.9 | 68.56 |
| Slaughterhouse | 1.73 | 118.79 | 68.8 |
| GZA | 1.9 | 131.13 | 68.98 |
| Cee-Lo | 1.38 | 96.5 | 69.85 |
| Cee-Lo Green | 1.38 | 96.5 | 69.85 |
| Salt N Pepa | 1.5 | 107.82 | 71.76 |
| Salt N Pepa | 1.5 | 107.82 | 71.76 |
| Skee-Lo | 1.43 | 105.14 | 73.35 |
| Afu-Ra | 1.27 | 93.62 | 73.96 |
| Ja Rule | 1.35 | 100.91 | 74.69 |
| Busta Rhymes | 1.16 | 87.32 | 75.02 |
| Jungle Brothers | 1.65 | 125.57 | 76 |
| RZA | 1.52 | 115.52 | 76.11 |
| Little Brother | 1.66 | 126.69 | 76.48 |
| Threat | 1.12 | 85.87 | 76.69 |
| M.O.P. | 1.21 | 93.55 | 77.3 |
| Mash Out Posse (M.O.P.) | 1.21 | 93.55 | 77.3 |
| Esham | 1.5 | 118.3 | 78.71 |
| TLC | 1.44 | 115.37 | 80.25 |
| Jay-Z | 1.05 | 84.3 | 80.4 |
| Jay-Z & R. Kelly | 1.05 | 84.3 | 80.4 |
| Blueprint | 1.05 | 84.41 | 80.55 |
| Aceyalone | 1.44 | 119.23 | 82.67 |
| K-Rino | 2.17 | 181.97 | 83.95 |
| Sevin | 2.59 | 220.06 | 85 |
| Saafir | 1.47 | 125.31 | 85 |
| Master Ace | 1.31 | 112.93 | 86.12 |
| The Beatnuts | 1.33 | 114.94 | 86.33 |
| Ice-T | 1.43 | 123.91 | 86.93 |
| Kurtis Blow | 1.07 | 93.49 | 87 |
| Masta Ace | 1.27 | 111.44 | 87.52 |
| House of Pain | 1.25 | 109.2 | 87.62 |
| Flame | 1.47 | 131.93 | 89.75 |
| MF Grimm | 1.29 | 124.1 | 95.83 |
| Akon | 0.93 | 90.03 | 96.61 |
| Chino XL | 1.38 | 133.95 | 97.05 |
| Reks | 1.25 | 122.41 | 97.86 |
| Spoonie Gee | 1.96 | 192.65 | 98.25 |
| Black Market Militia | 1.59 | 156.35 | 98.5 |
| Will Smith | 1.01 | 100.18 | 99.46 |
| Sir Mix-A-Lot | 0.76 | 76.8 | 101.35 |
| Cannibal Ox | 1.24 | 126.58 | 102.29 |
| Roots Manuva | 1.02 | 104.64 | 102.78 |
| George Clinton | 1.17 | 122.89 | 104.89 |
| Kanye West | 1.15 | 124.58 | 108.14 |
| Coolio | 0.98 | 106.11 | 108.4 |
| Jaylib | 1.02 | 116.85 | 114.69 |
| Swollen Members | 0.97 | 111.02 | 114.75 |
| Mr. Lif | 1.21 | 141.63 | 117.38 |
| Black Star | 1.02 | 121.4 | 119.26 |
| Copywrite | 1.02 | 122.01 | 119.88 |
| Natas | 1.03 | 124.74 | 121 |
| Eric B. & Rakim | 1.05 | 127.87 | 121.23 |
| Rakim | 1.05 | 127.87 | 121.23 |
| Tech N9ne | 0.91 | 111.1 | 122.51 |
| Gym Class Heroes | 0.77 | 96.03 | 124.82 |
| The Streets | 0.93 | 117.18 | 126.65 |
| Kottonmouth Kings | 0.88 | 111.8 | 127.31 |
| Junior M.A.F.I.A. | 0.8 | 104.05 | 129.26 |
| Notorious B.I.G. | 0.8 | 104.07 | 129.28 |
| Common | 1 | 131.78 | 132.37 |
| Common Sense | 1 | 131.78 | 132.37 |
| Akrobatik | 1.3 | 172.73 | 133 |
| Hopsin | 1 | 133.06 | 133.06 |
| Slaine | 0.82 | 111.1 | 135.86 |
| Foreign Exchange | 1.01 | 139.01 | 137 |
| J. Cole | 1.03 | 142.99 | 138.59 |
| UTFO | 1.13 | 156.69 | 138.67 |
| Guru | 0.79 | 110.89 | 140.64 |
| GangStarr | 0.79 | 110.92 | 140.67 |
| Souls of Mischief | 0.83 | 117.45 | 141.14 |
| Yung Ro | 0.81 | 116.73 | 143.66 |
| Lil Wayne | 0.9 | 129.3 | 143.82 |
| Young Mc | 0.7 | 101.2 | 144.5 |
| One.Be.Lo | 0.88 | 136.18 | 155.25 |
| Vents | 0.63 | 99.75 | 157.4 |
| Kool Keith | 0.68 | 109.32 | 159.77 |
| Kool Keith | 0.68 | 109.32 | 159.77 |
| Insane Clown Posse | 0.72 | 115.35 | 160.53 |
| Vakill | 0.69 | 110.55 | 160.67 |
| Ill Bill | 0.76 | 123.47 | 161.85 |
| Eminem | 0.73 | 118.96 | 163.11 |
| K-Os | 0.7 | 115.2 | 165.68 |
| El-P | 0.68 | 114.79 | 168.81 |
| Nicki Minaj | 0.65 | 110.71 | 171.5 |
| Calm | 0.61 | 106.32 | 175.03 |
| Zion I | 0.62 | 109.23 | 176.58 |
| X-Clan | 0.92 | 164.34 | 179.38 |
| Killah Priest | 1.13 | 202.41 | 179.68 |
| Vast Aire | 0.77 | 143.85 | 185.89 |
| Kesha | 0.57 | 106.9 | 187.68 |
| Jurassic 5 | 0.58 | 109.95 | 188.37 |
| T-Bone | 0.7 | 141.32 | 202.59 |
| Gnarls Barkley | 0.55 | 111.5 | 204.3 |
| Immortal Technique | 0.73 | 149.02 | 204.36 |
| Apathy | 0.55 | 127.76 | 231.43 |
| The Genius | 0.52 | 122.55 | 235.18 |
| Jehst | 0.56 | 135.31 | 240 |
| Flavor Flav | 0.58 | 143.41 | 249.04 |
| Army of the Pharaohs | 0.53 | 135.19 | 256.12 |
| Princess Superstar | 0.32 | 82.05 | 257.64 |
| Slow V & Retrospect | 0.45 | 116.15 | 260 |
| The Roots | 0.53 | 138.81 | 262 |
| Beastie Boys | 0.39 | 103.74 | 268.37 |
| Beastie Boys | 0.39 | 103.74 | 268.37 |
| MC chris | 0.37 | 103.83 | 277.69 |
| Company Flow | 0.48 | 136.51 | 281.67 |
| P.O.S. | 0.4 | 132.1 | 332.81 |
| Cage | 0.42 | 142 | 340.33 |
| Arsonists | 0.32 | 113.27 | 350 |
| Lupe Fiasco | 0.42 | 149.79 | 353.11 |
| Blackalicious | 0.33 | 117.81 | 353.2 |
| Time | 0.39 | 136.57 | 353.63 |
| Sage Francis | 0.37 | 136.84 | 374 |
| Necro | 0.33 | 126.33 | 378.76 |
| Atmosphere | 0.34 | 131.4 | 384.24 |
| PJ | 0.27 | 111.7 | 407.71 |
| Flobots | 0.38 | 158.57 | 414.79 |
| Brother Ali | 0.31 | 131.43 | 427.14 |
| Cunninlynguists | 0.22 | 115.91 | 518.6 |
| BoB | 0.18 | 102.95 | 565.56 |
| Holocaust | 0.22 | 129.22 | 597 |
| Aesop Rock | 0.19 | 132.9 | 716.5 |
| Bishop Lamont | 0.14 | 117.18 | 828.83 |
| Black Sheep | 0.11 | 107.75 | 951.4 |
| Buck 65 | 0.12 | 121 | 1037 |
| Ras Kass | 0.13 | 230.35 | 1776 |

So… What’s the pattern? Backpackers have high scores because they are always concerned about “authenticity”. Other than that, I agree with you that there should be something here but I don’t really see anything consistent and articulatable.
has nothing to do with ‘authenticity’, i dont think. just that, simple phonetic spelling mistakes can be mined and understood in context.
[...] did some stuff on trends in how people talk about artists on Youtube but something like how often people are [...]
I don’t understand what the chart is showing. Are the numbers under ‘dis’ and ‘this’ flat quantities?