Welcome, Guest. Please Login or Register    
 
smk mk64 mksc mkdd mkds mkwii mk7 mk8
general   mafia   smk   mk64   mksc   mkdd   mkds   mkw   mk7   mk8   |   problems   |   discord   irc
 
  Home Search Members Login Register
 
Pages: 1
Send Topic Print
We can now add videos to runs on the PP! (Read 331 times)
Arvo57
Ninja
*****
Offline

#1 degen

2662 sex records
Finland
Gender: male
We can now add videos to runs on the PP!
04/29/20 at 17:28:07
 
I'm just gonna make a thread so the most amount of people possible know about this
______________________________________________________________________


We can now link videos to our times on the PP, but since it's a lot of work I'm going to be pretty strict with what I add since the adding process isn't the smoothest thing in the world, at least compared to MKLeaderboards.

Basically, to get your videos added to the site, using the right format is essential so adding them will be nice and quick for the updaters (I'm assuming we will be adding a LOT of stuff). Penev made an edit to the parser that can automatically add the video link into the time, or any other comment actually The link makes it so you can go to the video directly. Check my profile if you want to see what it looks like. (http://www.mariokart64.com/mkw/profile.php?pid=1239)

The way you include videos within your times is by writing the video link on the same line as the submission, after the regular submission. So for example if you wanted to add a time, you'd normally submit the time like this:


Date: Aug 20, 2019
Name: Jonathan Corwin

LC: 1:17.547


to add a video you'd make the submission like this:


Date: Aug 20, 2019
Name: Jonathan Corwin

LC: 1:17.547 https://www.youtube.com/watch?v=FsBO6KNUY9s



THE PARSER ONLY RECOGNIZES THIS, IF THE LINK STARTS WITH "http://" or "https://" AND IS AFTER THE TIME, ON THE SAME LINE OF TEXT.

IMPORTANT ^^^


Note that you can also re-submit old times that are already on the site to get videos added to them. The reason we won't do this atm is having to manually re-enter the date, time and name every time we do this. We would essentially have the re-submit a sizable portion of the entire database and we also have other things to do.

If there are a large amount of submissions that don't use the correct format I'm going to start ignoring them. Please use the correct format.

I'm gonna try to get in contact with Vega to edit the time submission tutorial post.
Back to top
 
 

Timesheet

Discord: arvo57
View Profile WWW   IP Logged
Mango Man
Ninja
*****
Offline

Living fast, well...
trying to.   
   DUCK SQUAD

1878 days karting
Your Local Mango Tree
Gender: male
Re: We can now add videos to runs on the PP!
Reply #1 - 04/29/20 at 17:37:22
 
Great thing I suggested this feature! Smiley

As Bryce once said: "Mango man mkw community legend"
And as Bryce also once said: "mango man is the 3rd coming of christ"

I will admit being an MKW community legend AND the 3rd coming of christ is harder than it seems, but I will do whatever it takes to do my job and to do it well!  Smiley
Back to top
 
 

Mango Man, Speedrunning Extraordinaire!
View Profile WWW   IP Logged
Arvo57
Ninja
*****
Offline

#1 degen

2662 days karting
Finland
Gender: male
Re: We can now add videos to runs on the PP!
Reply #2 - 05/08/20 at 05:49:08
 
UPDATE:

Wrote a python script that makes it pretty easy to mass add videos to existing runs

added some vids on LC, took 5 minutes

good stuff
Back to top
 
« Last Edit: 05/08/20 at 06:31:55 by Arvo57 »  

Timesheet

Discord: arvo57
View Profile WWW   IP Logged
Mango Man
Ninja
*****
Offline

Living fast, well...
trying to.   
   DUCK SQUAD

seen 1878 mj vids
Your Local Mango Tree
Gender: male
Re: We can now add videos to runs on the PP!
Reply #3 - 05/08/20 at 06:14:36
 
I can't believe you've been manually typing them out before!
SAD!
Back to top
 
 

Mango Man, Speedrunning Extraordinaire!
View Profile WWW   IP Logged
InnovΔ
Legend
*****
Offline



3008 sex records
Milky Way Galaxy
Gender: both
Re: We can now add videos to runs on the PP!
Reply #4 - 05/08/20 at 06:46:06
 
Arvo57 wrote on 05/08/20 at 05:49:08:
UPDATE:

Wrote a python script that makes it pretty easy to mass add videos to existing runs

added some vids on LC, took 5 minutes

good stuff


What does it do? search YouTube for "Luigi Circuit" or whatever?
Back to top
 
 

Ketchup wrote on 07/08/21 at 07:33:13:
if you anonymize the names of mkw predators eventually the whole leaderboard will be anonymous


Puddings wrote on 03/11/23 at 19:31:52:
mkdd gayass mf game, y'all tried playing bitches?
View Profile   IP Logged
Arvo57
Ninja
*****
Offline

#1 degen

helped 2662 people
Finland
Gender: male
Re: We can now add videos to runs on the PP!
Reply #5 - 05/08/20 at 06:59:09
 
I still have to find the videos for myself. (I did it by just going through a bunch of different top 10s so the runs that were never on any top 10s will not be added this way)

The only thing the program does is convert the top 100 runs from the HTML format displayed on the site to the format used for submissions so I can easily add the videos into that format.

pretty simple but makes adding videos to runs actually doable by one person
Back to top
 
« Last Edit: 05/08/20 at 08:09:21 by Arvo57 »  

Timesheet

Discord: arvo57
View Profile WWW   IP Logged
Arvo57
Ninja
*****
Offline

#1 degen

2662 days karting
Finland
Gender: male
Re: We can now add videos to runs on the PP!
Reply #6 - 05/08/20 at 15:44:15
 
Alright, I mass added videos from LC to RR (combined). Took longer than I thought, but I should be done with every category in the next few days.

I'm sure I missed some vids since I'm only going by MKL, mkwrs, wheel tops, alt tops and the old weebly sites, there are also barely any flap videos that I can find without searching for each one on youtube.


The script is only really useful for mass adding updates on one track, and only for the top 100. If you find a missing time, just write a submission for it and post it on the Times Submission Thread, it's not worth the effort to run the entire top 100 through the script just to add one video, making the submission manually is faster in that case.

I might try to write up another script in the future that does the same thing as this one, but goes through a player's timesheet instead. That would be pretty neat since there's an option on MKL where you can view a player's timesheet so it would be easy to get videos over that way.

Gonna be a bit harder to write that script tho, we'll see. In a few days I'm just gonna be stuck inside by myself with no other work so I'll probably give it a shot.



EDIT: Went through every combined chart, gonna do nosc right away I've literally been doing this for 6 hours straight already oh no

EDIT2: Added everything I could find on all categories, I'll try to make the second script that checks profiles later.

EDIT3:

Created a script that goes through the combined and no-sc tables from the player's profile page and returns all the times without videos in a format that works for the parser. It compares the 2 tables and doesn't duplicate any times.

Super nifty, very happy how this turned out. Only downside is having so spend a minute in inspect element every time I want to add videos to a profile, couldn't figure out a practical way to extract them automatically from the URL.

I'll test this baby out during the next few days  Wink
Back to top
 
« Last Edit: 05/09/20 at 13:10:30 by Arvo57 »  

Timesheet

Discord: arvo57
View Profile WWW   IP Logged
Arvo57
Ninja
*****
Offline

#1 degen

2662 days karting
Finland
Gender: male
Re: We can now add videos to runs on the PP!
Reply #7 - 05/09/20 at 13:46:13
 
Alright jk I'll just make the script public but I don't know what I'm doing

I wrote a readme that goes through it pretty simply and clumsily

You need python 3.x to run it, i hope it works on other computers

i actually know nothing about programming

so yeah pls if you wanna use this to add videos to people's timesheets feel free to submit them (pastebin is better, pls use that)

I have a uni report due in 2 days so ill be a bit busy, cant spend 15 hours a day updating PP every day

ask questions if you're interested

Timesheet - PP submission translator
Back to top
 
 

Timesheet

Discord: arvo57
View Profile WWW   IP Logged
Mango Man
Ninja
*****
Offline

Living fast, well...
trying to.   
   DUCK SQUAD

1878 days karting
Your Local Mango Tree
Gender: male
Re: We can now add videos to runs on the PP!
Reply #8 - 05/10/20 at 01:09:11
 
Arvo57 wrote on 05/09/20 at 13:46:13:
I have a uni report due in 2 days so ill be a bit busy, cant spend 15 hours a day updating PP every day

I mean...

I know someone who can Wink

It's me
Back to top
 
 

Mango Man, Speedrunning Extraordinaire!
View Profile WWW   IP Logged
Mango Man
Ninja
*****
Offline

Living fast, well...
trying to.   
   DUCK SQUAD

worships 1878 kartgods
Your Local Mango Tree
Gender: male
Re: We can now add videos to runs on the PP!
Reply #9 - 05/10/20 at 06:39:15
 
Arvo57 wrote on 05/09/20 at 13:46:13:
Alright jk I'll just make the script public but I don't know what I'm doing

I wrote a readme that goes through it pretty simply and clumsily

You need python 3.x to run it, i hope it works on other computers

i actually know nothing about programming

so yeah pls if you wanna use this to add videos to people's timesheets feel free to submit them (pastebin is better, pls use that)

I have a uni report due in 2 days so ill be a bit busy, cant spend 15 hours a day updating PP every day

ask questions if you're interested

Timesheet - PP submission translator

Same script as Arvo's except it looks better

Now instead of saying Code:
Player NameThomas Voss 

it says Code:
Player Name: Thomas Voss 



Also Arvo you TOTAL CLOWN are you hardcoding in the tracks! Smiley
Back to top
 
 

Mango Man, Speedrunning Extraordinaire!
View Profile WWW   IP Logged
WhatisLoaf
Karter
**
Offline

What is Loaf?

2166 days karting
Antwerp, Belgium
Gender: male
Re: We can now add videos to runs on the PP!
Reply #10 - 05/10/20 at 06:54:00
 
Nice work Arvo!

There are some really nice python modules that make things a little easier, this is by no means a "you should've done this!!". Just some things that can make your life easier.

You can actually pull html data directly from a url by using urllib.request. That way you don't need to copy paste manually.
For parsing and navigating html data there's a really nice module called BeautifulSoup (BS4) which lets you extract data based on tag names, id's etc.
Back to top
 
 
View Profile   IP Logged
Arvo57
Ninja
*****
Offline

#1 degen

2662 days karting
Finland
Gender: male
Re: We can now add videos to runs on the PP!
Reply #11 - 05/10/20 at 08:57:19
 
WhatisLoaf wrote on 05/10/20 at 06:54:00:
Nice work Arvo!

There are some really nice python modules that make things a little easier, this is by no means a "you should've done this!!". Just some things that can make your life easier.

You can actually pull html data directly from a url by using urllib.request. That way you don't need to copy paste manually.
For parsing and navigating html data there's a really nice module called BeautifulSoup (BS4) which lets you extract data based on tag names, id's etc.


Yeah, that would be awesome to implement, I'll try to mess around with that soon

And for some reason LC is embedded into the top part of the table and I hardcoded that because I already got the rest of the tracks to work
Back to top
 
 

Timesheet

Discord: arvo57
View Profile WWW   IP Logged
Arvo57
Ninja
*****
Offline

#1 degen

2662 days karting
Finland
Gender: male
Re: We can now add videos to runs on the PP!
Reply #12 - 05/10/20 at 11:50:50
 
Thanks loaf for bringing that up, instead of doing actual uni work I worked on this, priorities!

You now only have to enter the URL of the player's timesheet and their name and it should work the same way.

I tried it on people and it didn't break their profiles.


Profile - Submission translator v2

(and i made the inputs look a little nicer, 2 seconds of effort was too much for v1 but we're in the big league now)

EDIT: removed the line where i added pandas since it wasnt necessary

EDIT2: Here's the version for extracting top 100 pages, might aswell chuck that out there aswell, could be useful at some point
Back to top
 
 

Timesheet

Discord: arvo57
View Profile WWW   IP Logged
Pages: 1
Send Topic Print