Project Deluge: Difference between revisions
No edit summary |
No edit summary |
||
| (2 intermediate revisions by the same user not shown) | |||
| Line 60: | Line 60: | ||
'''Last Updated: | '''Last Updated: December 25, 2022''' <br> | ||
* '''Changelog: ''' | * '''Changelog: ''' | ||
** '''December 25, 2022: Released Xbox 360 and Nintendo Wii prototypes. ''' | |||
** '''September 18, 2021: Released Xbox and Dreamcast prototypes. Added more recently discovered final PS2 discs.''' | ** '''September 18, 2021: Released Xbox and Dreamcast prototypes. Added more recently discovered final PS2 discs.''' | ||
** '''April 17, 2021: Released PlayStation, Saturn, and CD-i prototypes.''' | ** '''April 17, 2021: Released PlayStation, Saturn, and CD-i prototypes.''' | ||
| Line 69: | Line 70: | ||
== Microsoft Xbox Prototypes == | == Microsoft Xbox Prototypes == | ||
[[File:Project Deluge - Microsoft Xbox.png|right|frameless|150px]] | [[File:Project Deluge - Microsoft Xbox.png|right|frameless|150px]] | ||
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs and DVD-Rs that are prone to deterioration with time. The bulk of the items from this lot | The majority of the items featured in this lot are mastered on recordable media such as CD-Rs and DVD-Rs that are prone to deterioration with time. The bulk of the items from this lot was dumped using either PowerISO or CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well. Discs can be mastered in various different ways. Most were mastered with a blank DVD-Video partition followed by an Xbox game partition, some were mastered with just a single Xbox partition, and few were mastered with a normal UDF partition. | ||
=== Builds === | === Builds === | ||
| Line 78: | Line 79: | ||
'''(Last Updated: September 18, 2021)''' | '''(Last Updated: September 18, 2021)''' | ||
== Microsoft Xbox 360 Prototypes == | |||
[[File:Project Deluge - Microsoft Xbox 360.png|right|frameless|150px]] | |||
The majority of the items featured in this lot are mastered on recordable media such as DVD-Rs and DVD-Rs that are prone to deterioration with time. The bulk of the items from this lot was dumped using either PowerISO or CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well. Discs can be mastered in various different ways. Most were mastered with a blank DVD-Video partition followed by an Xbox game partition, some were mastered with just a single Xbox partition, and few were mastered with a normal UDF partition. Some builds were also dumped with DiscImageCreator. | |||
=== Builds === | |||
Due to the sheer number of discs, we've split the builds into two lists: | |||
* [[Project Deluge - Microsoft Xbox 360 (List)|Unique prototypes and builds. (Current total count: {{#ask:[[Has origin lot::Project Deluge]] [[Has system::Xbox 360]]|format=count}}''')]] | |||
* [[Project Deluge - Microsoft Xbox 360 (Matches)|Duplicates]] - discs that match finals, other released prototypes, and prototypes from the same lot. | |||
== Nintendo Wii Prototypes == | |||
[[File:Project Deluge - Nintendo Wii.png|right|frameless|150px]] | |||
All Wii prototypes that are featured in this part of the lot were mastered on RVT-R, recordable variants of DVD-Rs specifically manufactured for the Nintendo RVT-R Reader console, and Writer drives (for burning) that are prone to deterioration with time. All items from this lot were dumped using an RVT-R Reader console with a debug signed version of Homebrew Channel installed, and dumped using a custom version of CleanRip to allow multiple dumps to be saved in the same directory for convenience. | |||
Note: Most build dates for these Wii prototypes come from dates written on the media itself. Because Wii games do not have a file system that carries file timestamps, dates specified explicitly by the developers are used whenever possible. | |||
=== Builds === | |||
Due to the sheer number of discs, we've split the builds into two lists: | |||
* [[Project Deluge - Nintendo Wii (List)|Unique prototypes and builds. (Current total count: {{#ask:[[Has origin lot::Project Deluge]] [[Has system::Nintendo Wii]]|format=count}}''')]] | |||
* [[Project Deluge - Nintendo Wii (Matches)|Duplicates]] - discs that match finals, other released prototypes, and prototypes from the same lot. | |||
'''(Last Updated: December 25, 2022)''' | |||
== Sega Dreamcast Prototypes == | == Sega Dreamcast Prototypes == | ||
[[File:Project Deluge - Sega Dreamcast.png|right|frameless|150px]] | [[File:Project Deluge - Sega Dreamcast.png|right|frameless|150px]] | ||
All of the items featured in this part of the lot are stored on GD-Rs, recordable media that are prone to deterioration with time. The bulk of the items from this lot | All of the items featured in this part of the lot are stored on GD-Rs, recordable media that are prone to deterioration with time. The bulk of the items from this lot was dumped on an actual Sega Dreamcast console with a System Disc 2 (required for reading GD-Rs on retail hardware) and Dreamcast SD Rip. | ||
=== Builds === | === Builds === | ||
| Line 93: | Line 118: | ||
== Sony PlayStation 2 Prototypes == | == Sony PlayStation 2 Prototypes == | ||
[[File:Project Deluge - Sony Playstation 2.png|right|frameless|150px]] | [[File:Project Deluge - Sony Playstation 2.png|right|frameless|150px]] | ||
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs and DVD-Rs that are prone to deterioration with time. The bulk of the items from this lot | The majority of the items featured in this lot are mastered on recordable media such as CD-Rs and DVD-Rs that are prone to deterioration with time. The bulk of the items from this lot was dumped using either PowerISO or CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well. | ||
=== Builds === | === Builds === | ||
| Line 101: | Line 126: | ||
* [[Project Deluge - Sony PlayStation 2 (Matches)|Duplicates]] - discs that match finals, other released prototypes, and prototypes from the same lot. | * [[Project Deluge - Sony PlayStation 2 (Matches)|Duplicates]] - discs that match finals, other released prototypes, and prototypes from the same lot. | ||
'''(Last Updated: | '''(Last Updated: September 18, 2021)''' | ||
== Sony PlayStation Prototypes == | == Sony PlayStation Prototypes == | ||
[[File:Project Deluge - Sony Playstation.png|right|frameless|150px]] | [[File:Project Deluge - Sony Playstation.png|right|frameless|150px]] | ||
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot | The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot was dumped using either PowerISO or CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well. | ||
=== Builds === | === Builds === | ||
| Line 117: | Line 142: | ||
== Sega Saturn Prototypes == | == Sega Saturn Prototypes == | ||
[[File:Project Deluge - Sega Saturn.png|right|frameless|150px]] | [[File:Project Deluge - Sega Saturn.png|right|frameless|150px]] | ||
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot | The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot was dumped using either PowerISO or CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well. | ||
=== Builds === | === Builds === | ||
| Line 129: | Line 154: | ||
== Philips CD-i Prototypes == | == Philips CD-i Prototypes == | ||
[[File:Project Deluge - Philips CD-i.png|right|frameless|150px]] | [[File:Project Deluge - Philips CD-i.png|right|frameless|150px]] | ||
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot | The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot was dumped using either PowerISO or CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well. | ||
=== Builds === | === Builds === | ||
| Line 163: | Line 188: | ||
'''6. Is there a release schedule?''' <br> | '''6. Is there a release schedule?''' <br> | ||
As this is an | As this is an active ongoing project, there is no tentative release schedule. As soon as the parts of the lot that can be sorted into a set are archived, processed, and documented, a release will soon follow. | ||
'''7. Where do final build dates come from? Where does release date information come from?''' <br> | '''7. Where do final build dates come from? Where does release date information come from?''' <br> | ||
Final build dates are determined using the latest logical timestamp that can be found on the equivalent final. The timestamp is often found on the last modified file on the disc (as other parts of the metadata on the disc are often incorrect and post date the actual time the game was actually compiled/built). If timestamps are noticeably inaccurate, the next logical source for the date is used instead (such as the metadata). The final release data information was often sourced from GameFAQs which often lists more specific dates for various regions of the same game. | Final build dates are determined using the latest logical timestamp that can be found on the equivalent final. The timestamp is often found on the last modified file on the disc (as other parts of the metadata on the disc are often incorrect and post-date the actual time the game was actually compiled/built). If timestamps are noticeably inaccurate, the next logical source for the date is used instead (such as the metadata). The final release data information was often sourced from GameFAQs which often lists more specific dates for various regions of the same game. | ||
'''8. What is a composite checksum?''' <br> | '''8. What is a composite checksum?''' <br> | ||
| Line 172: | Line 197: | ||
'''9. How are the items featured in the lot evaluated?''' <br> | '''9. How are the items featured in the lot evaluated?''' <br> | ||
A custom tool was used to generate metadata from each disc from various data sets, such as composite checksums, main executable checksums, volume modification dates, disc metadata etc. The collected data is then gathered into a single spreadsheet where the same information that can be taken from the items in the lot can be compared to. If the composite checksum of an item in the lot matches against | A custom tool was used to generate metadata from each disc from various data sets, such as composite checksums, main executable checksums, volume modification dates, disc metadata, etc. The collected data is then gathered into a single spreadsheet where the same information that can be taken from the items in the lot can be compared to. If the composite checksum of an item in the lot matches against data generated from a non-pre-production part of the Redump set, then the files on that particular disc are the same as a final build. If the main executable checksum matches the main executable checksum from one of the data sets but the composite checksum doesn’t match, the item would then be manually checked against the partially matched builds to determine what differs between the builds. This is where builds that were watermarked, builds that have small inconsequential changes (like a small change in SYSTEM.CNF for PlayStation builds), and builds that contain obvious errors can be identified. These changes have been documented in the subsequent matched build pages for each system in the lot. The changes mentioned on these pages are enough to replicate the alterations that make up the build perfectly. If none of the data assessed from the item matches any part of the collected data sets, then that particular item is classified as non-final. | ||
'''10. I want to research a particular item from the lot, how should I go about sharing the information I’ve discovered?''' <br> | '''10. I want to research a particular item from the lot, how should I go about sharing the information I’ve discovered?''' <br> | ||
See | See answers to questions #1 and #5. | ||
'''11. Are the items in the lot free from errors or defects caused during the archival process?''' <br> | '''11. Are the items in the lot free from errors or defects caused during the archival process?''' <br> | ||
| Line 181: | Line 206: | ||
'''12. How were disc errors determined?''' <br> | '''12. How were disc errors determined?''' <br> | ||
After determining that an item in the lot is producing a unique checksum value that doesn’t match anything on Redump or on our wiki, if copies of an item exist in the same lot - errors can be determined by comparing where the changes lie between the two copies. If one copy is filled with filler bytes due to the drive not being able to read sectors, then that copy contains errors. If the item in the lot is an optical disc using ISO 9660 (such as CD-Rs), errors can be determined by checking the EDC/ECC data written with the data on the same disc. For these, we used an open source tool called [https://github.com/claunia/edccchk edccchk, an EDC/ECC checker for RAW (2352 bytes/sector) CD images, to locate and interpret errors.] If the errors are correctable using the included data or | After determining that an item in the lot is producing a unique checksum value that doesn’t match anything on Redump or on our wiki, if copies of an item exist in the same lot - errors can be determined by comparing where the changes lie between the two copies. If one copy is filled with filler bytes due to the drive not being able to read sectors, then that copy contains errors. If the item in the lot is an optical disc using ISO 9660 (such as CD-Rs), errors can be determined by checking the EDC/ECC data written with the data on the same disc. For these, we used an open-source tool called [https://github.com/claunia/edccchk edccchk, an EDC/ECC checker for RAW (2352 bytes/sector) CD images, to locate and interpret errors.] If the errors are correctable using the included data or if the errors in question do not directly affect the files on the disc, then the item is good enough for release. | ||
'''13. How are items with protection handled?''' <br> | '''13. How are items with protection handled?''' <br> | ||
If an item is determined to be utilizing protection (such as ‘dongle’ protection), we made attempts to create | If an item is determined to be utilizing protection (such as ‘dongle’ protection), we made attempts to create a .xdelta patch so you can patch the protection out of the original dump. To apply a .xdelta patch, you can use a tool like [https://github.com/marco-calautti/DeltaPatcher Delta Patcher] on the original image. | ||
'''14. Why are there multiple copies of a particular item in the same lot?''' <br> | '''14. Why are there multiple copies of a particular item in the same lot?''' <br> | ||
| Line 192: | Line 217: | ||
For disc images, a combination of PowerISO and CloneCD was used to dump every CD/DVD in the lot initially. A Memorex MRX-650LE v6 AM61 was primarily used to dump everything with a PLEXTOR DVDR PX-716UF 1.11 used as a backup. More drives have since been acquired. | For disc images, a combination of PowerISO and CloneCD was used to dump every CD/DVD in the lot initially. A Memorex MRX-650LE v6 AM61 was primarily used to dump everything with a PLEXTOR DVDR PX-716UF 1.11 used as a backup. More drives have since been acquired. | ||
'''16. Why do some builds post date the final release?''' <br> | '''16. Why do some builds post-date the final release?''' <br> | ||
This is not exactly known and the reasons can vary depending on the game. If the item in the lot is a build that predates a certain release but post dates others, then that build can be determined as a ‘localization’ or in progress revisional build. Some final builds were possibly altered to include protection so that they could only function on certain console models (like developer consoles). In some scenarios, the build could also be an unreleased second revision. | This is not exactly known and the reasons can vary depending on the game. If the item in the lot is a build that predates a certain release but post-dates others, then that build can be determined as a ‘localization’ or in progress revisional build. Some final builds were possibly altered to include protection so that they could only function on certain console models (like developer consoles). In some scenarios, the build could also be an unreleased second revision. | ||
'''17. Why do some of the filenames in the lot have the wrong identifier/system (i.e “PSX” when the item is meant for “PS2”)?''' <br> | '''17. Why do some of the filenames in the lot have the wrong identifier/system (i.e “PSX” when the item is meant for “PS2”)?''' <br> | ||
| Line 199: | Line 224: | ||
'''18. Were there some items that couldn’t be archived? What’s going on with them?''' <br> | '''18. Were there some items that couldn’t be archived? What’s going on with them?''' <br> | ||
At this point there are a few things in the lot that could be only partially archived due to the state of the media itself. We’re in the process of redumping those items and will try to get them out in the future. If a successful dump cannot be made, we will release the best possible dump and make note of it. | At this point, there are a few things in the lot that could be only partially archived due to the state of the media itself. We’re in the process of redumping those items and will try to get them out in the future. If a successful dump cannot be made, we will release the best possible dump and make note of it. | ||
'''19. Is anything up for sale?''' <br> | '''19. Is anything up for sale?''' <br> | ||
| Line 208: | Line 233: | ||
'''21. I can’t run any of these games in an emulator. Can I get support?''' <br> | '''21. I can’t run any of these games in an emulator. Can I get support?''' <br> | ||
No. Please do not bother emulator developers in | No. Please do not bother emulator developers in regard to anything in this lot. They most likely will not help you. | ||
== Resources: == | == Resources: == | ||
| Line 214: | Line 239: | ||
* [[News/Project Deluge: PlayStation 1, Saturn, and CD-I (Part 2)|Project Deluge: PlayStation 1, Saturn, and CD-i (April 17, 2021)]] | * [[News/Project Deluge: PlayStation 1, Saturn, and CD-I (Part 2)|Project Deluge: PlayStation 1, Saturn, and CD-i (April 17, 2021)]] | ||
* [[Project Deluge: Xbox and Dreamcast|Project Deluge: Xbox and Dreamcast (September 18, 2021)]] | * [[Project Deluge: Xbox and Dreamcast|Project Deluge: Xbox and Dreamcast (September 18, 2021)]] | ||
* [[Project Deluge: Xbox 360 and Wii|Project Deluge: Xbox 360 and Wii (December 25, 2022)]] | |||
* [https://tcrf.net The Cutting Room Floor (TCRF)] | * [https://tcrf.net The Cutting Room Floor (TCRF)] | ||
* [https://archive.org Internet Archive (IA)] | * [https://archive.org Internet Archive (IA)] | ||
Latest revision as of 23:44, December 25, 2022
Project Deluge is an ongoing project to archive and assess all of the items featured in a lot of video game development material that has been gathered over the course of many years. This has been made possible through the dedication of only one extremely kind individual, who has taken on the herculean task of dumping every single thing in the lot by themselves.
Each item in the lot was assessed by a team of dedicated individuals for playability and integrity on both software (via emulation) and hardware when necessary. Each item was then lightly documented and given a general overview of some of the main interesting facts about the item in question.
| Iniche | Researcher / Lead / Catalogue |
| Jason Scott | Archive.org / Hosting |
| Master Emerald | Artist |
| drx | Researcher / Script Writing |
| ehw | Researcher / Lead |
| Sazpaimon | Researcher / Script Writing / Streamer |
| Zoda-Y13 | Researcher |
| GopherGirl | Researcher |
| Xkeeper | Researcher (TCRF) |
| Rusty | Researcher (TCRF) |
| Shoemanbundy | Researcher |
| Hwd45 | Researcher |
| SolidSnake | Researcher |
| DigitalWarrior | Researcher |
| Nex | Researcher |
| Drac | Researcher |
Last Updated: December 25, 2022
- Changelog:
- December 25, 2022: Released Xbox 360 and Nintendo Wii prototypes.
- September 18, 2021: Released Xbox and Dreamcast prototypes. Added more recently discovered final PS2 discs.
- April 17, 2021: Released PlayStation, Saturn, and CD-i prototypes.
- March 20, 2021: Initial release, added PlayStation 2 and some related asset discs.
Microsoft Xbox Prototypes
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs and DVD-Rs that are prone to deterioration with time. The bulk of the items from this lot was dumped using either PowerISO or CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well. Discs can be mastered in various different ways. Most were mastered with a blank DVD-Video partition followed by an Xbox game partition, some were mastered with just a single Xbox partition, and few were mastered with a normal UDF partition.
Builds
Due to the sheer number of discs, we've split the builds into two lists:
- Unique prototypes and builds. (Current total count: 349)
- Duplicates - discs that match finals, other released prototypes, and prototypes from the same lot.
(Last Updated: September 18, 2021)
Microsoft Xbox 360 Prototypes
The majority of the items featured in this lot are mastered on recordable media such as DVD-Rs and DVD-Rs that are prone to deterioration with time. The bulk of the items from this lot was dumped using either PowerISO or CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well. Discs can be mastered in various different ways. Most were mastered with a blank DVD-Video partition followed by an Xbox game partition, some were mastered with just a single Xbox partition, and few were mastered with a normal UDF partition. Some builds were also dumped with DiscImageCreator.
Builds
Due to the sheer number of discs, we've split the builds into two lists:
- Unique prototypes and builds. (Current total count: 207)
- Duplicates - discs that match finals, other released prototypes, and prototypes from the same lot.
Nintendo Wii Prototypes
All Wii prototypes that are featured in this part of the lot were mastered on RVT-R, recordable variants of DVD-Rs specifically manufactured for the Nintendo RVT-R Reader console, and Writer drives (for burning) that are prone to deterioration with time. All items from this lot were dumped using an RVT-R Reader console with a debug signed version of Homebrew Channel installed, and dumped using a custom version of CleanRip to allow multiple dumps to be saved in the same directory for convenience.
Note: Most build dates for these Wii prototypes come from dates written on the media itself. Because Wii games do not have a file system that carries file timestamps, dates specified explicitly by the developers are used whenever possible.
Builds
Due to the sheer number of discs, we've split the builds into two lists:
- Unique prototypes and builds. (Current total count: 114)
- Duplicates - discs that match finals, other released prototypes, and prototypes from the same lot.
(Last Updated: December 25, 2022)
Sega Dreamcast Prototypes
All of the items featured in this part of the lot are stored on GD-Rs, recordable media that are prone to deterioration with time. The bulk of the items from this lot was dumped on an actual Sega Dreamcast console with a System Disc 2 (required for reading GD-Rs on retail hardware) and Dreamcast SD Rip.
Builds
Due to the sheer number of discs, we've split the builds into two lists:
- Unique prototypes and builds. (Current total count: 135)
- Duplicates - discs that match finals, other released prototypes, and prototypes from the same lot.
(Last Updated: September 18, 2021)
Sony PlayStation 2 Prototypes
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs and DVD-Rs that are prone to deterioration with time. The bulk of the items from this lot was dumped using either PowerISO or CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well.
Builds
Due to the sheer number of discs, we've split the builds into two lists:
- Unique prototypes and builds. (Current total count: 755)
- Duplicates - discs that match finals, other released prototypes, and prototypes from the same lot.
(Last Updated: September 18, 2021)
Sony PlayStation Prototypes
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot was dumped using either PowerISO or CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well.
Builds
Due to the sheer number of discs, we've split the builds into two lists:
- Unique prototypes and builds. (Current total count: 372)
- Duplicates - discs that match finals, other released prototypes, and prototypes from the same lot.
(Last Updated: April 17, 2021)
Sega Saturn Prototypes
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot was dumped using either PowerISO or CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well.
Builds
Due to the sheer number of discs, we've split the builds into two lists:
- Unique prototypes and builds. (Current total count: 84)
- Duplicates - discs that match finals, other released prototypes, and prototypes from the same lot.
(Last Updated: April 17, 2021)
Philips CD-i Prototypes
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot was dumped using either PowerISO or CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well.
Builds
Due to the sheer number of discs, we've split the builds into two lists:
- Unique prototypes and builds. (Current total count: 25)
- Duplicates - discs that match finals, other released prototypes, and prototypes from the same lot.
(Last Updated: April 17, 2021)
Assets
This part of the lot contains various miscellaneous assets, such as source code, press releases, screenshots, video clips, and backups. Assets can be for strictly media/publication use or can be developer backups. This section might be broken down if more is discovered.
Click here to see the current list of assets. Current total: 2
(Last Updated: March 20, 2021)
FAQ
1. How can I help with Project Deluge?
Create an account on Hidden Palace and/or The Cutting Room Floor (TCRF) and help research the differences that can be found between each build and the equivalent final.
2. Where do the items featured in Project Deluge come from?
Various defunct media outlets, developers, and odds and ends from various collectors over a period of time. Every single item in the lot is currently being archived from the efforts of one single person and evaluated by a group of dedicated individuals.
3. What’s covered in Project Deluge?
Items that span across many console generations, from prototypes to various assets.
4. I believe I found an error that can cause issues running a game, how do I report it?
See answer to #5.
5. I found an error on one of the wiki page entries for an item in the lot, how should I correct it? Feel free to create an account on the wiki and make the necessary corrections. If you feel that a page needs to be renamed, please set up a redirect when moving the page so that the original page name can still be used to find the appropriate article.
6. Is there a release schedule?
As this is an active ongoing project, there is no tentative release schedule. As soon as the parts of the lot that can be sorted into a set are archived, processed, and documented, a release will soon follow.
7. Where do final build dates come from? Where does release date information come from?
Final build dates are determined using the latest logical timestamp that can be found on the equivalent final. The timestamp is often found on the last modified file on the disc (as other parts of the metadata on the disc are often incorrect and post-date the actual time the game was actually compiled/built). If timestamps are noticeably inaccurate, the next logical source for the date is used instead (such as the metadata). The final release data information was often sourced from GameFAQs which often lists more specific dates for various regions of the same game.
8. What is a composite checksum?
A composite checksum is the sum of the checksums for all the readable files on a disc image. Checksums for individual files on a disc image are calculated using a checksum algorithm that isn’t susceptible to collisions. The individual file checksums are then added together to create a unique checksum value that reflects the files themselves, rather than the entire disc image file itself. This way, changes in the files on the disc can be indicated by changes in the composite checksum value when comparing similar builds based on the same title in the pursuit of finding matches. A composite checksum is useful in the event that changes on the disc image occur that do not affect the physical data on the disc, like metadata and mastering differences. It’s also useful for determining small changes in files if other parts of the disc are comparable to other builds (useful for determining watermarks).
9. How are the items featured in the lot evaluated?
A custom tool was used to generate metadata from each disc from various data sets, such as composite checksums, main executable checksums, volume modification dates, disc metadata, etc. The collected data is then gathered into a single spreadsheet where the same information that can be taken from the items in the lot can be compared to. If the composite checksum of an item in the lot matches against data generated from a non-pre-production part of the Redump set, then the files on that particular disc are the same as a final build. If the main executable checksum matches the main executable checksum from one of the data sets but the composite checksum doesn’t match, the item would then be manually checked against the partially matched builds to determine what differs between the builds. This is where builds that were watermarked, builds that have small inconsequential changes (like a small change in SYSTEM.CNF for PlayStation builds), and builds that contain obvious errors can be identified. These changes have been documented in the subsequent matched build pages for each system in the lot. The changes mentioned on these pages are enough to replicate the alterations that make up the build perfectly. If none of the data assessed from the item matches any part of the collected data sets, then that particular item is classified as non-final.
10. I want to research a particular item from the lot, how should I go about sharing the information I’ve discovered?
See answers to questions #1 and #5.
11. Are the items in the lot free from errors or defects caused during the archival process?
There are no guarantees that each dump is free from errors. All the prerelease items were often authored on recordable media that was not meant to last indefinitely. For older items, especially ones authored on recordable optical media, the items were often mastered using duplicators that introduced further errors that could have been baked into each copy of the duplicated disc. Normally we would archive discs using the best methods available, but given the circumstances surrounding the lot itself, this wasn’t readily available in time for some of the items in the lot. We attempted to rigorously test and analyze each disc and note errors wherever possible. As such, we would rather have some dump than no dump at all.
12. How were disc errors determined?
After determining that an item in the lot is producing a unique checksum value that doesn’t match anything on Redump or on our wiki, if copies of an item exist in the same lot - errors can be determined by comparing where the changes lie between the two copies. If one copy is filled with filler bytes due to the drive not being able to read sectors, then that copy contains errors. If the item in the lot is an optical disc using ISO 9660 (such as CD-Rs), errors can be determined by checking the EDC/ECC data written with the data on the same disc. For these, we used an open-source tool called edccchk, an EDC/ECC checker for RAW (2352 bytes/sector) CD images, to locate and interpret errors. If the errors are correctable using the included data or if the errors in question do not directly affect the files on the disc, then the item is good enough for release.
13. How are items with protection handled?
If an item is determined to be utilizing protection (such as ‘dongle’ protection), we made attempts to create a .xdelta patch so you can patch the protection out of the original dump. To apply a .xdelta patch, you can use a tool like Delta Patcher on the original image.
14. Why are there multiple copies of a particular item in the same lot?
Most review and preview builds aren’t mastered with unique builds and were usually produced in mass and sent to various media outlets. The only thing that can be unique between each copy is certain metadata and/or changes to help identify a build. These changes have been documented in the subsequent matched build pages for each system in the lot.
15. What hardware and software was used to archive the items in the lot?
For disc images, a combination of PowerISO and CloneCD was used to dump every CD/DVD in the lot initially. A Memorex MRX-650LE v6 AM61 was primarily used to dump everything with a PLEXTOR DVDR PX-716UF 1.11 used as a backup. More drives have since been acquired.
16. Why do some builds post-date the final release?
This is not exactly known and the reasons can vary depending on the game. If the item in the lot is a build that predates a certain release but post-dates others, then that build can be determined as a ‘localization’ or in progress revisional build. Some final builds were possibly altered to include protection so that they could only function on certain console models (like developer consoles). In some scenarios, the build could also be an unreleased second revision.
17. Why do some of the filenames in the lot have the wrong identifier/system (i.e “PSX” when the item is meant for “PS2”)?
Some of the items in the lot were initially misidentified by the archiver for a certain system (usually because the game in question was a multiplatform release). Due to the process of evaluating the items in the lot, we had to leave the original identifiers in.
18. Were there some items that couldn’t be archived? What’s going on with them?
At this point, there are a few things in the lot that could be only partially archived due to the state of the media itself. We’re in the process of redumping those items and will try to get them out in the future. If a successful dump cannot be made, we will release the best possible dump and make note of it.
19. Is anything up for sale?
No. At this time, everything is going back into storage.
20. Is this a leak?
No, all of these were sourced from old physical media, usually given out to old defunct magazines or old estate sales.
21. I can’t run any of these games in an emulator. Can I get support?
No. Please do not bother emulator developers in regard to anything in this lot. They most likely will not help you.
Resources:
- Project Deluge: PlayStation 2 (Initial Announcement Article) (March 20, 2021)
- Project Deluge: PlayStation 1, Saturn, and CD-i (April 17, 2021)
- Project Deluge: Xbox and Dreamcast (September 18, 2021)
- Project Deluge: Xbox 360 and Wii (December 25, 2022)
- The Cutting Room Floor (TCRF)
- Internet Archive (IA)