Official Codex Discord Server

  1. Welcome to rpgcodex.net, a site dedicated to discussing computer based role-playing games in a free and open fashion. We're less strict than other forums, but please refer to the rules.

    "This message is awaiting moderator approval": All new users must pass through our moderation queue before they will be able to post normally. Until your account has "passed" your posts will only be visible to yourself (and moderators) until they are approved. Give us a week to get around to approving / deleting / ignoring your mundane opinion on crap before hassling us about it. Once you have passed the moderation period (think of it as a test), you will be able to post normally, just like all the other retards.
    Dismiss Notice

Wabbajack or: How someone finally made a tool that automatically downloads and installs modlists

Discussion in 'Bethesda Game Studios' started by Turisas, Aug 24, 2019.

  1. Turisas Arch Devil Patron

    Turisas
    Joined:
    May 25, 2009
    Messages:
    9,638
    https://github.com/halgari/wabbajack

    Wabbajack - An automated modlist installer for TES/Fallout games
    The general idea behind this program is fairly simple. Given a Mod Organizer 2 folder and profile, generate list of instructions that will allow a program to automatically recreate the contents of the folder on another machine. Think of it as replication, but without ever distributing copyrighted files or syncing data between the source and destination machine. The end result is a program that recreate a modlist on a computer while respecting the rights of the game publisher and the mod authors.

    Social Links
    What Wabbajack can do
    At this point you may be wondering how much of a complex modlist Wabbajack can handle. At this point it's more about what Wabbajack can't handle, but let's do a rundown of all the supported features:

    • Support for the following games is tested on a regular basis
      • Fallout 4
      • Fallout New Vegas
      • Skyrim SE
      • Skyrim LE
    • Support for automatic downloads from the following sources
      • Nexus Mods (Premium accounts only)
      • Dropbox
      • Google Drive
      • Mega
      • ModDB
      • Direct URLs (with custom header support)
    • Support the following archive types
      • .zip
      • .7z
      • .rar
    • The following mod installation types are supported
      • Files installed with our without fomod isntallers
      • Manually installed mods
      • Renamed/deleted/moved files are detected and handled
      • Multiple mods installed into the same mod folder
      • A mod split across multiple mod folders
      • Any tools installed in the MO2 folder. Want your users to have BethIni or xEdit? Just put them in a folder inside the MO2 install folder
      • ENBseries files that exist in the game folder
      • SKSE install
    • The following situations are automatically detected and handled by the automated binary patcher (not an exhaustive list)
      • ESP cleaning
      • form 44 conversion
      • ESP to ESL conversion
      • Adding masters
      • Dummy ESPs created by CAO
      • (really any ESP modifications are handled)
      • Mesh fixing
      • Texture compression / fixing The following BSA operations are detected by extracting or creating BSAs via Wabbajack's custom BSA routines
      • BSA Unpacking
      • BSA Creation (packing loose files)
      • BSA repacking (unpacking, fixing files and repacking)
    That being said, there are some cases where we would need to do a bit more work to develop:

    • Manually downloaded files
    • LL Files (currently no plans to implement)
    • esp to esm conversion (there are hacks for this)
    • binary patching of non-bsa huge files. 256MB is the largest size Wabbajack can currently handle with the binary patcher


    About fucking time, there's of course Automaton but it's limited in many ways that Wabbajack isn't:

    "install F4EE (Fallout 4 modlist that uses Wabbajack). Full install from start to finish took about 5 minutes on my machine. And that includes about 240 mods and 50GB of downloads."
     
    • Informative x 5
    • Brofist x 3
    • nice x 2
    • hopw roewur ne x 1
    • meh x 1
    • Friendly x 1
    ^ Top  
  2. Chippy Prophet

    Chippy
    Joined:
    May 5, 2018
    Messages:
    2,078
    Should be useful for when all the porn mods come out for BG3.

    Show Spoiler
    But other than that, pretty useful for all the porn mods that are out for Skyrim and FNV
     
    ^ Top  
  3. deuxhero Arcane

    deuxhero
    Joined:
    Jul 30, 2007
    Messages:
    8,486
    Location:
    Flowery Land
    So you need a Nexus premium account to get any use out of it? Meh
     
    • decline decline x 1
    ^ Top  
  4. Yosharian Cipher

    Yosharian
    Joined:
    May 28, 2018
    Messages:
    3,468
    Location:
    Night City
    I'm struggling to understand the difference between this and Automaton?
     
    • it is a mystery it is a mystery x 1
    ^ Top  
  5. Turisas Arch Devil Patron

    Turisas
    Joined:
    May 25, 2009
    Messages:
    9,638
    He was one of the devs of Automaton, think of this as a refined and more feature-rich continuation from that (Automaton is pretty much dead in the water, apparently):

    And that was posted a month ago so things are moving quite quickly, at the moment they're working on getting an installer for Lexy's modlist which is a fucking massive ordeal to install yourself: https://wiki.step-project.com/User:DarkladyLexy/Lexys_LOTD_SE

    I'd say the biggest differences at the moment are that Wabbajack already supports more games than Automaton, and can do that binary patching which can be very useful if the modlist creator has done custom tweaks / does them later when updates are made.


    Yeah that's the biggest bummer, but unfortunately Nexus only offers its API to premium users - only way around it would be if someone knowledgeable enough in coding would make a fork of this project and had the program scrape the limited 1MB/s links off of Nexus that are available for free accounts.
     
    ^ Top  
  6. Yosharian Cipher

    Yosharian
    Joined:
    May 28, 2018
    Messages:
    3,468
    Location:
    Night City
    More drama? Jeez
     
    ^ Top  
  7. Turisas Arch Devil Patron

    Turisas
    Joined:
    May 25, 2009
    Messages:
    9,638
    • incline incline x 1
    ^ Top  
  8. Deadman Arcane Patron

    Deadman
    Joined:
    Nov 15, 2010
    Messages:
    3,517
    Pathfinder: Kingmaker
    Will this tool cause a great asspain to all the mod creators who didn't like their mods to be a part of modpacks?
    Will this lead to the creation of the ultimate Anti-Wabbajack Technologyâ„¢ like this:
     
    • Funny Funny x 1
    ^ Top  
  9. Turisas Arch Devil Patron

    Turisas
    Joined:
    May 25, 2009
    Messages:
    9,638
    For sure, but they can't really do much except pout since it's Nexusmods that enables Wabbajack to work to begin with, not to mention Nexusmods themselves are working on something similar with the upcoming Vortex modpacks (that's going to be a one-size-fits-all approach covering all their hosted mods across various games, so Wabbajack will likely be the better choice still for Bethesda games, specifically). Modders can either suck it up or leave and try their luck over at moddb (lol) or some other site no one really cares about.
     
    ^ Top  
  10. Deadman Arcane Patron

    Deadman
    Joined:
    Nov 15, 2010
    Messages:
    3,517
    Pathfinder: Kingmaker
    Have Nexus considered allowing access to their api for non-privileged/free users? Wabbajack so far works only for paid users as far as I understand it.
     
    ^ Top  
  11. Turisas Arch Devil Patron

    Turisas
    Joined:
    May 25, 2009
    Messages:
    9,638
    Nah, the whole reason the API exists in the first place is to get more premium users, obviously. People can share their personal keys of course, but if the key then goes into wide circulation and Nexus bans it, the owner would be shit out of luck.
     
    ^ Top  
  12. Fedora Master Arcane Patron

    Fedora Master
    Joined:
    Jun 28, 2017
    Messages:
    5,526
    Now if only mods could fix Skyrim or FO4.
     
    • Fabulously Optimistic Fabulously Optimistic x 1
    ^ Top  
  13. Darth Canoli Cipher

    Darth Canoli
    Joined:
    Jun 8, 2018
    Messages:
    2,114
    Location:
    Perched on a tree
    We have nukes and incinerators, what else do you need ?
     
    ^ Top  
  14. HarveyBirdman Savant

    HarveyBirdman
    Joined:
    Jan 5, 2019
    Messages:
    867
    What's wrong with Wyre Bash?
     
    ^ Top  
  15. Butter Magister

    Butter
    Joined:
    Oct 1, 2018
    Messages:
    1,479
    Nothing?
     
    ^ Top  
  16. Mustawd Arcane

    Mustawd
    Joined:
    Jan 10, 2015
    Messages:
    12,136
    What about Fallout 1/2?
     
    ^ Top  
  17. HarveyBirdman Savant

    HarveyBirdman
    Joined:
    Jan 5, 2019
    Messages:
    867
    Exactly. What's the selling point for these other mod managers?
     
    ^ Top  
  18. Butter Magister

    Butter
    Joined:
    Oct 1, 2018
    Messages:
    1,479
    My understanding is that this program automatically downloads and installs arbitrarily large lists of mods.
     
    • Agree Agree x 1
    ^ Top  
  19. Turisas Arch Devil Patron

    Turisas
    Joined:
    May 25, 2009
    Messages:
    9,638
    Yeah Wabbajack is not a mod manager, it uses MO2 as its base. The whole point of it is to reduce the monotony of having to install massive guides like https://wiki.step-project.com/User:DarkladyLexy/Lexys_LOTD_SE by hand; rather than clicking all those links one by one yourself, Wabbajack installer does it all for you.
     
    ^ Top  
  20. HarveyBirdman Savant

    HarveyBirdman
    Joined:
    Jan 5, 2019
    Messages:
    867
    Oh, that makes sense. I've never modded nearly to that extent.
     
    ^ Top  
  21. zapotec Learned

    zapotec
    Joined:
    Feb 7, 2018
    Messages:
    353
    The biggest problem of this application is skyrim :lol:
     
    ^ Top  

(buying stuff via the above buttons helps us pay the hosting bills, thanks!)