scraper for ScummVM
  • hi,
    for what files is the scraper looking for in case of ScummVM?
    in my scummvm folder i have placed in subfolders all my old "Discworld", "Simon the Sorcerer" and "Monkey Island" files.
    but the scrapper is not finding any of the titles and unfortunately if there are no dummy files in the scummvm folder, it is not possible to start ScummVM because of empty list, in the piplay menu (there is only a [< - Back] button).

    the scraper for Atari2600, Playstation makes also less sense, because there is no standard, how files have to be named... or id there a list of file names, for what the scraper is looking for?
  • For scummvm: the format is a bit different than other systems (It's still sort of a work in progress. I had to contact the scummvm developers directly to try and get info on their naming schema) I'm going to use Beneath Steel Sky as my example file.

    so I have sky.zip
    I unzip it and move the contents to /home/pi/pimame/roms/scummvm/sky/
    so now /home/pi/pimame/roms/scummvm/sky/ contains the following files:
    sky.cpt
    sky.dnr
    sky.dsk
    *the name of parent folder ('sky') can be anything, as long as the contents are correct.

    The scraper will open /home/pi/pimame/roms/scummvm/ then grab a list of all subfolders. It will run through all of the subfolders and check for file matches in the database. When it finds a match, then it will add it to the database.

    You can still go back to the old version, if you edit the config.db -> table: menu_items
    Find the scummvm item (should be #11)
    change type to: 'frontend'
    change command to: 'scummvm'
  • So I have to apologize for the scummvm portion of the scraper. I had grabbed a handful of the freeware games for testing, and they all seemed to follow the same naming pattern. The main program file was named the same as the short name. So that is what the scraper looks for. You should be able to just add a blank file to each subfolder containing the short name. so add a file named 'dw' to the Discworld subfolder, 'simon1' for Simon the sorcerer, and 'monkey' for monkey island.
  • thank you...
    3 minutes ago, i just left a notice for scummvm, to be able to start the emulator from the menu
    http://pimame.org/forum/discussion/comment/5639#Comment_5639

    i did the same as you said at the same time ... :D

    and thank you for the hint with the Games Short Names.

    i just installed raspbian and PiPLAY 0.8beta8 (version=10) from scratch.
    what is the scraper id in that table for scummvm...
    that column is currently empty, so the scraper does not search at all.
    maybe the installer script or config.db template is currently work in progress.

    BTW: it makes lot of fun to play with the database (even is looks a bit chaotic)
    way better than the json shit.
  • Atari 2600 and ps1 both use their own frontends, so you don't need to worry about scraping them. I added them to the database, just in case in future versions we decide to change things up.
  • yes, no problem any more...
    thank you for all the work.

    i installed sqlitebrowser and i can change everything by myself now... \o/
  • hmmm. yeah, that's weird. Just put the number 21 in there and it should scrape fine. Those numbers correspond to the values in games_master.db->table: system_id

    Thanks for the heads up, I'll have to get that fixed too!
  • and maybe now i know, why my scummvm games where not found...
    all the files are in big letters on my USB stick...
    and i guess the scraper is only looking for the small letter names...
  • nah, the scraper will convert it to lowercase when it does the search. It just needs to find a file with the same name as the shortcode in the database (case in-sensitive). I just added an update, so now it can be either a file or the containing folder name. But I also told Shea that for the time being, we should just stick to using the scummvm frontend. Hopefully I can figure out a better way to do this.
  • ok, i played a bit around with the scummvm things...

    1'st, i renamed all files to lower case...
    and the scraper were now found the matching file in all sub-folders correctly.
    (no need to add an empty dummy file anymote to get fetched by scraper - except of simon1... simon1 has only a simon.??? file, so ther i added an empty simon1 file to got fetched)

    2'nd, in the database local.db the values of command column for all scummmv games are wrong. in my case
    scummvm "/media/USB/GAMES/ScummVM/Monkey Island 1" monkey
    but it should be like this
    scummvm monkey
    after each scraper run for scummvm, i changed it by hand for my scummvm games with:
    UPDATE local_roms
    SET command = "scummvm " || rom_file
    WHERE system = 11


    3'rd, the user has to take care about to give the games in scummvm the exact same ID as the PiPLAY game short names are.
    i saw, that scummvm extends the ID of the game
    by the language (like "de", "gb", ...)
    and/or medium (like "cd")
    and/or screen type (like "vga")
    and maybe others...
    for example the game "Monkey Island 1" has normally the ID: monkey.
    but summvm put additional information to it and gave ID: monkey-vga-de. with the result, that trying to start monkey island by calling "scummvm monkey" failed, because in the ~/.scummrc file the MokeyIsland got the ID: monkey-vga-de.
    s the user has to guarantee to rename the ID of the game in scummvm to the short names ("monkey"), that the PiPLAY menu uses.
    maybe that is only an issue when using non english versions of the games.

    so only the 2'nd point is something that could be fixed by PiPLAY-team.
    the 1'st point is fixed as you told.
    and the 3'rd point, the user has to know and has to take care about it.
    or is it possible to parse the .scummrc file and put the [IDs] to the database to use for the scummvm command...?

    anyhow... if all the three points are correct, then scummvm works with type "emulator" very well, you can choose the game straight from th PiPLAY menu list.

    one side note... for all such emulators advmame, mame4all, scummvm, (atari, playstation), i would wish to have a menu list entry to start the emulator itself without a specific game selected.

    and another wish would be to keep the last selected game selected after returning to the PiPLAY menu when exiting the game... currently PiPLAY only returns to the last selected emulator, but then the top item [< - Back] is always selected.
  • @beta_tester - the scummrc file only lists games that have been 'installed' by the (scummvm) front end.

    The reason that the games weren't running after using the scraper is because the config.db->menu_items table didn't get updated with the correct scummvm command on this last update that we have out. The scummvm 'command' should be 'scummvm -f -p ' so when the scraper runs, it will list
    scummvm -f -p  "/media/USB/GAMES/ScummVM/Monkey Island 1" monkey


    I just grabbed a copy of monkey island 1 and ran the scraper on it and it worked fine.
  • OOoooh and with that (-f -p options), it will work, even the ID in ScummVM's .scummrc i different? very cooool, i didn't know that.

    so that i am playing so long time around for?
    i only have to stay quiet and have to wait...
    you guys will just find the right way and fix it... :)
  • nah, it's all good. making noise is how we know what to fix. There's only so much time in the day for troubleshooting so many different possibilities. That's why we are always releasing in beta stages.
  • Ho exactly do I add Scumm VM to the scraper?
  • in config.db->menu_items, make sure there is a rompath in the scummvm entry and set the scraper_id to 21. scumm handles things a bit differently, so you will have sub-folders inside your roms folder (one subfolder per game). That sub folder can have any number of extra files/sub-folders of its own, as long as it contains at least 1 file (or the folder itself) that is named the same as the 'short name'