Difference between revisions of "Project Deluge"

From Hidden Palace
Jump to navigation Jump to search
 
(16 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
[[Has article type::Lot| ]]
 
[[Has article type::Lot| ]]
 
[[File:Project Deluge Logo.png|center|frameless]]<br><br>
 
[[File:Project Deluge Logo.png|center|frameless]]<br><br>
Project Deluge is an ongoing project to archive and assess all of the items featured in a lot of video game development material that has been gathered over the course of many years. This has been made possible through the dedication of only one extremely kind individual, who has taken on the herculean task of dumping every single thing in the lot by themselves.  
+
Project Deluge is an ongoing project to archive and assess all of the items featured in a lot of video game development material that has been gathered over the course of many years. This has been made possible through the dedication of only one extremely kind individual, who has taken on the herculean task of dumping every single thing in the lot by themselves.
  
Each item in the lot was assessed by a team of dedicated individuals for playability and integrity on both software (via emulation) and hardware when necessary. Each item was then lightly documented and given a general overview of some of the main interesting facts about the item in question.  
+
Each item in the lot was assessed by a team of dedicated individuals for playability and integrity on both software (via emulation) and hardware when necessary. Each item was then lightly documented and given a general overview of some of the main interesting facts about the item in question.
  
 
<center>
 
<center>
Line 60: Line 60:
  
  
'''Last Updated: March 20, 2021''' <br><br>
+
'''Last Updated: September 18, 2021''' <br>
 +
* '''Changelog: '''
 +
** '''September 18, 2021: Released Xbox and Dreamcast prototypes. Added more recently discovered final PS2 discs.'''
 +
** '''April 17, 2021: Released PlayStation, Saturn, and CD-i prototypes.'''
 +
** '''March 20, 2021: Initial release, added PlayStation 2 and some related asset discs. '''
 +
<br><br>
 +
 
 +
== Microsoft Xbox Prototypes ==
 +
[[File:Project Deluge - Microsoft Xbox.png|right|frameless|150px]]
 +
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs and DVD-Rs that are prone to deterioration with time. The bulk of the items from this lot were dumped using either PowerISO and CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well. Discs can be mastered in various different ways. Most were mastered with a blank DVD-Video partition followed by an Xbox game partition, some were mastered with just a single Xbox partition, and few were mastered with a normal UDF partition.
 +
 
 +
=== Builds ===
 +
Due to the sheer number of discs, we've split the builds into two lists:
 +
 
 +
* [[Project Deluge - Microsoft Xbox (List)|Unique prototypes and builds. (Current total count: {{#ask:[[Has origin lot::Project Deluge]] [[Has system::Xbox]]|format=count}}''')]]
 +
* [[Project Deluge - Microsoft Xbox (Matches)|Duplicates]] - discs that match finals, other released prototypes, and prototypes from the same lot.
 +
 
 +
'''(Last Updated: September 18, 2021)'''
 +
 
 +
== Sega Dreamcast Prototypes ==
 +
[[File:Project Deluge - Sega Dreamcast.png|right|frameless|150px]]
 +
All of the items featured in this part of the lot are stored on GD-Rs, recordable media that are prone to deterioration with time. The bulk of the items from this lot were dumped on an actual Sega Dreamcast console with a System Disc 2 (required for reading GD-Rs on retail hardware) and Dreamcast SD Rip.
 +
 
 +
=== Builds ===
 +
Due to the sheer number of discs, we've split the builds into two lists:
 +
 
 +
* [[Project Deluge - Sega Dreamcast (List)|Unique prototypes and builds. (Current total count: {{#ask:[[Has origin lot::Project Deluge]] [[Has system::Dreamcast]]|format=count}}''')]]
 +
* [[Project Deluge - Sega Dreamcast (Matches)|Duplicates]] - discs that match finals, other released prototypes, and prototypes from the same lot.
 +
 
 +
'''(Last Updated: September 18, 2021)'''
  
 
== Sony PlayStation 2 Prototypes ==
 
== Sony PlayStation 2 Prototypes ==
 
[[File:Project Deluge - Sony Playstation 2.png|right|frameless|150px]]
 
[[File:Project Deluge - Sony Playstation 2.png|right|frameless|150px]]
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs and DVD-Rs that are prone to deterioration with time. The bulk of the items from this lot were dumped using either PowerISO and CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well.  
+
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs and DVD-Rs that are prone to deterioration with time. The bulk of the items from this lot were dumped using either PowerISO and CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well.
  
 
=== Builds ===
 
=== Builds ===
 
Due to the sheer number of discs, we've split the builds into two lists:
 
Due to the sheer number of discs, we've split the builds into two lists:
* [[Project Deluge - Sony PlayStation 2 (List)|Unique prototypes and builds.]]
+
 
 +
* [[Project Deluge - Sony PlayStation 2 (List)|Unique prototypes and builds. (Current total count: {{#ask:[[Has origin lot::Project Deluge]] [[Has system::PlayStation 2]]|format=count}}''')]]
 
* [[Project Deluge - Sony PlayStation 2 (Matches)|Duplicates]] - discs that match finals, other released prototypes, and prototypes from the same lot.
 
* [[Project Deluge - Sony PlayStation 2 (Matches)|Duplicates]] - discs that match finals, other released prototypes, and prototypes from the same lot.
  
'''(Last Updated: March 20, 2021)'''
+
'''(Last Updated: September 18, 2021)'''
 +
 
 +
== Sony PlayStation Prototypes ==
 +
[[File:Project Deluge - Sony Playstation.png|right|frameless|150px]]
 +
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot were dumped using either PowerISO and CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well.
 +
 
 +
=== Builds ===
 +
Due to the sheer number of discs, we've split the builds into two lists:
 +
 
 +
* [[Project Deluge - Sony PlayStation (List)|Unique prototypes and builds. (Current total count: {{#ask:[[Has origin lot::Project Deluge]] [[Has system::PlayStation]]|format=count}}''')]]
 +
* [[Project Deluge - Sony PlayStation (Matches)|Duplicates]] - discs that match finals, other released prototypes, and prototypes from the same lot.
 +
 
 +
'''(Last Updated: April 17, 2021)'''
 +
 
 +
== Sega Saturn Prototypes ==
 +
[[File:Project Deluge - Sega Saturn.png|right|frameless|150px]]
 +
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot were dumped using either PowerISO and CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well.
 +
 
 +
=== Builds ===
 +
Due to the sheer number of discs, we've split the builds into two lists:
 +
 
 +
* [[Project Deluge - Sega Saturn (List)|Unique prototypes and builds. (Current total count: {{#ask:[[Has origin lot::Project Deluge]] [[Has system::Sega Saturn]]|format=count}}''')]]
 +
* [[Project Deluge - Sega Saturn (Matches)|Duplicates]] - discs that match finals, other released prototypes, and prototypes from the same lot.
 +
 
 +
'''(Last Updated: April 17, 2021)'''
 +
 
 +
== Philips CD-i Prototypes ==
 +
[[File:Project Deluge - Philips CD-i.png|right|frameless|150px]]
 +
The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot were dumped using either PowerISO and CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well.
 +
 
 +
=== Builds ===
 +
Due to the sheer number of discs, we've split the builds into two lists:
 +
 
 +
* [[Project Deluge - Philips CD-i (List)|Unique prototypes and builds. (Current total count: {{#ask:[[Has origin lot::Project Deluge]] [[Has system::Philips CD-i]]|format=count}}''')]]
 +
* [[Project Deluge - Philips CD-i (Matches)|Duplicates]] - discs that match finals, other released prototypes, and prototypes from the same lot.
 +
 
 +
'''(Last Updated: April 17, 2021)'''
  
 
== Assets ==
 
== Assets ==
Line 77: Line 143:
 
This part of the lot contains various miscellaneous assets, such as source code, press releases, screenshots, video clips, and backups. Assets can be for strictly media/publication use or can be developer backups. This section might be broken down if more is discovered. <br>
 
This part of the lot contains various miscellaneous assets, such as source code, press releases, screenshots, video clips, and backups. Assets can be for strictly media/publication use or can be developer backups. This section might be broken down if more is discovered. <br>
  
<center> [[Project Deluge - Assets (List)|Click here to see the current list of assets. Current total: '''2''']]</center>
+
[[Project Deluge - Assets (List)|Click here to see the current list of assets. Current total: '''2''']] <br>
 
'''(Last Updated: March 20, 2021)'''
 
'''(Last Updated: March 20, 2021)'''
  
 
== FAQ ==
 
== FAQ ==
'''1.) How can I help with Project Deluge?''' <br>
+
'''1. How can I help with Project Deluge?''' <br>
 
Create an account on Hidden Palace and/or [https://tcrf.net The Cutting Room Floor (TCRF)] and help research the differences that can be found between each build and the equivalent final.
 
Create an account on Hidden Palace and/or [https://tcrf.net The Cutting Room Floor (TCRF)] and help research the differences that can be found between each build and the equivalent final.
  
'''2.) Where do the items featured in Project Deluge come from?''' <br>
+
'''2. Where do the items featured in Project Deluge come from?''' <br>
 
Various defunct media outlets, developers, and odds and ends from various collectors over a period of time. Every single item in the lot is currently being archived from the efforts of one single person and evaluated by a group of dedicated individuals.
 
Various defunct media outlets, developers, and odds and ends from various collectors over a period of time. Every single item in the lot is currently being archived from the efforts of one single person and evaluated by a group of dedicated individuals.
  
'''3.) What’s covered in Project Deluge?''' <br>
+
'''3. What’s covered in Project Deluge?''' <br>
 
Items that span across many console generations, from prototypes to various assets.
 
Items that span across many console generations, from prototypes to various assets.
  
'''4.) I believe I found an error that can cause issues running a game, how do I report it?''' <br>
+
'''4. I believe I found an error that can cause issues running a game, how do I report it?''' <br>
 
See answer to #5.
 
See answer to #5.
  
'''5.) I found an error on one of the wiki page entries for an item in the lot, how should I correct it?'''
+
'''5. I found an error on one of the wiki page entries for an item in the lot, how should I correct it?'''
 
Feel free to create an account on the wiki and make the necessary corrections. If you feel that a page needs to be renamed, please set up a redirect when moving the page so that the original page name can still be used to find the appropriate article.
 
Feel free to create an account on the wiki and make the necessary corrections. If you feel that a page needs to be renamed, please set up a redirect when moving the page so that the original page name can still be used to find the appropriate article.
  
'''6.) Is there a release schedule?''' <br>
+
'''6. Is there a release schedule?''' <br>
 
As this is an actively on going project, there is no tentative release schedule. As soon as the parts of the lot that can be sorted into a set are archived, processed, and documented, a release will be soon to follow.
 
As this is an actively on going project, there is no tentative release schedule. As soon as the parts of the lot that can be sorted into a set are archived, processed, and documented, a release will be soon to follow.
  
'''7.) Where do final build dates come from? Where does release date information come from?''' <br>
+
'''7. Where do final build dates come from? Where does release date information come from?''' <br>
 
Final build dates are determined using the latest logical timestamp that can be found on the equivalent final. The timestamp is often found on the last modified file on the disc (as other parts of the metadata on the disc are often incorrect and post date the actual time the game was actually compiled/built). If timestamps are noticeably inaccurate, the next logical source for the date is used instead (such as the metadata). The final release data information was often sourced from GameFAQs which often lists more specific dates for various regions of the same game.
 
Final build dates are determined using the latest logical timestamp that can be found on the equivalent final. The timestamp is often found on the last modified file on the disc (as other parts of the metadata on the disc are often incorrect and post date the actual time the game was actually compiled/built). If timestamps are noticeably inaccurate, the next logical source for the date is used instead (such as the metadata). The final release data information was often sourced from GameFAQs which often lists more specific dates for various regions of the same game.
  
'''8.) What is a composite checksum?''' <br>
+
'''8. What is a composite checksum?''' <br>
 
A composite checksum is the sum of the checksums for all the readable files on a disc image. Checksums for individual files on a disc image are calculated using a checksum algorithm that isn’t susceptible to collisions. The individual file checksums are then added together to create a unique checksum value that reflects the files themselves, rather than the entire disc image file itself. This way, changes in the files on the disc can be indicated by changes in the composite checksum value when comparing similar builds based on the same title in the pursuit of finding matches. A composite checksum is useful in the event that changes on the disc image occur that do not affect the physical data on the disc, like metadata and mastering differences. It’s also useful for determining small changes in files if other parts of the disc are comparable to other builds (useful for determining watermarks).
 
A composite checksum is the sum of the checksums for all the readable files on a disc image. Checksums for individual files on a disc image are calculated using a checksum algorithm that isn’t susceptible to collisions. The individual file checksums are then added together to create a unique checksum value that reflects the files themselves, rather than the entire disc image file itself. This way, changes in the files on the disc can be indicated by changes in the composite checksum value when comparing similar builds based on the same title in the pursuit of finding matches. A composite checksum is useful in the event that changes on the disc image occur that do not affect the physical data on the disc, like metadata and mastering differences. It’s also useful for determining small changes in files if other parts of the disc are comparable to other builds (useful for determining watermarks).
  
 
+
'''9. How are the items featured in the lot evaluated?''' <br>
'''9.) How are the items featured in the lot evaluated?''' <br>
 
 
A custom tool was used to generate metadata from each disc from various data sets, such as composite checksums, main executable checksums, volume modification dates, disc metadata etc. The collected data is then gathered into a single spreadsheet where the same information that can be taken from the items in the lot can be compared to. If the composite checksum of an item in the lot matches against a data generated from a non pre-production part of the Redump set, then the files on that particular disc is the same as a final build. If the main executable checksum matches the main executable checksum from one of the data sets but the composite checksum doesn’t match, the item would then be manually checked against the partially matched builds to determine what differs between the builds. This is where builds that were watermarked, builds that have small inconsequential changes (like a small change in SYSTEM.CNF for PlayStation builds), and builds that contain obvious errors can be identified. These changes have been documented in the subsequent matched build pages for each system in the lot. The changes mentioned on these pages are enough to replicate the alterations that make up the build perfectly. If none of the data assessed from the item matches any part of the collected data sets, then that particular item is classified as non-final.
 
A custom tool was used to generate metadata from each disc from various data sets, such as composite checksums, main executable checksums, volume modification dates, disc metadata etc. The collected data is then gathered into a single spreadsheet where the same information that can be taken from the items in the lot can be compared to. If the composite checksum of an item in the lot matches against a data generated from a non pre-production part of the Redump set, then the files on that particular disc is the same as a final build. If the main executable checksum matches the main executable checksum from one of the data sets but the composite checksum doesn’t match, the item would then be manually checked against the partially matched builds to determine what differs between the builds. This is where builds that were watermarked, builds that have small inconsequential changes (like a small change in SYSTEM.CNF for PlayStation builds), and builds that contain obvious errors can be identified. These changes have been documented in the subsequent matched build pages for each system in the lot. The changes mentioned on these pages are enough to replicate the alterations that make up the build perfectly. If none of the data assessed from the item matches any part of the collected data sets, then that particular item is classified as non-final.
  
 
+
'''10. I want to research a particular item from the lot, how should I go about sharing the information I’ve discovered?''' <br>
'''10.) I want to research a particular item from the lot, how should I go about sharing the information I’ve discovered?''' <br>
 
 
See answer to question #1 and #5.
 
See answer to question #1 and #5.
  
 +
'''11. Are the items in the lot free from errors or defects caused during the archival process?''' <br>
 +
There are no guarantees that each dump is free from errors. All the prerelease items were often authored on recordable media that was not meant to last indefinitely. For older items, especially ones authored on recordable optical media, the items were often mastered using duplicators that introduced further errors that could have been baked into each copy of the duplicated disc. Normally we would archive discs using the best methods available, but given the circumstances surrounding the lot itself, this wasn’t readily available in time for some of the items in the lot. We attempted to rigorously test and analyze each disc and note errors wherever possible. As such, we would rather have some dump than no dump at all.
  
'''11.) Are the items in the lot free from errors or defects caused during the archival process?'''
+
'''12. How were disc errors determined?''' <br>
There are no guarantees that each dump is free from errors. All the prerelease items were often authored on recordable media that was not meant to last indefinitely. For older items, especially ones authored on recordable optical media, the items were often mastered using duplicators that introduced further errors that could have been baked into each copy of the duplicated disc. Normally we would archive discs using the best methods available, but given the circumstances surrounding the lot itself, this wasn’t readily available in time for some of the items in the lot. We attempted to rigorously test and analyze each disc and note errors wherever possible. As such, we would rather have some dump than no dump at all.  
+
After determining that an item in the lot is producing a unique checksum value that doesn’t match anything on Redump or on our wiki, if copies of an item exist in the same lot - errors can be determined by comparing where the changes lie between the two copies. If one copy is filled with filler bytes due to the drive not being able to read sectors, then that copy contains errors. If the item in the lot is an optical disc using ISO 9660 (such as CD-Rs), errors can be determined by checking the EDC/ECC data written with the data on the same disc. For these, we used an open source tool called [https://github.com/claunia/edccchk edccchk, an EDC/ECC checker for RAW (2352 bytes/sector) CD images, to locate and interpret errors.] If the errors are correctable using the included data or that the errors in question do not directly affect the files on the disc, then the item is good enough for release.
  
'''12.) How were disc errors determined?’’ <br>
+
'''13. How are items with protection handled?''' <br>
After determining that an item in the lot is producing a unique checksum value that doesn’t match anything on Redump or on our wiki, if copies of an item exist in the same lot - errors can be determined by comparing where the changes lie between the two copies. If one copy is filled with filler bytes due to the drive not being able to read sectors, then that copy contains errors. If the item in the lot is an optical disc using ISO 9660 (such as CD-Rs), errors can be determined by checking the EDC/ECC data written with the data on the same disc. For these, we used an open source tool called [https://github.com/claunia/edccchk edccchk, an EDC/ECC checker for RAW (2352 bytes/sector) CD images, to locate and interpret errors.] If the errors are correctable using the included data or that the errors in question do not directly affect the files on the disc, then the item is good enough for release.
 
 
 
'''13.) How are items with protection handled?''' <br>
 
 
If an item is determined to be utilizing protection (such as ‘dongle’ protection), we made attempts to create an .xdelta patch so you can patch the protection out of the original dump. To apply an .xdelta patch, you can use a tool like [https://github.com/marco-calautti/DeltaPatcher Delta Patcher] on the original image.
 
If an item is determined to be utilizing protection (such as ‘dongle’ protection), we made attempts to create an .xdelta patch so you can patch the protection out of the original dump. To apply an .xdelta patch, you can use a tool like [https://github.com/marco-calautti/DeltaPatcher Delta Patcher] on the original image.
  
'''14.) Why are there multiple copies of a particular item in the same lot?''' <br>
+
'''14. Why are there multiple copies of a particular item in the same lot?''' <br>
Most review and preview builds aren’t mastered with unique builds and were usually produced in mass and sent to various media outlets. The only thing that can be unique between each copy is certain metadata and/or changes to help identify a build. These changes have been documented in the subsequent matched build pages for each system in the lot.  
+
Most review and preview builds aren’t mastered with unique builds and were usually produced in mass and sent to various media outlets. The only thing that can be unique between each copy is certain metadata and/or changes to help identify a build. These changes have been documented in the subsequent matched build pages for each system in the lot.
  
'''15.) What hardware and software was used to archive the items in the lot?''' <br>
+
'''15. What hardware and software was used to archive the items in the lot?''' <br>
 
For disc images, a combination of PowerISO and CloneCD was used to dump every CD/DVD in the lot initially. A Memorex MRX-650LE v6 AM61 was primarily used to dump everything with a PLEXTOR DVDR PX-716UF 1.11 used as a backup. More drives have since been acquired.
 
For disc images, a combination of PowerISO and CloneCD was used to dump every CD/DVD in the lot initially. A Memorex MRX-650LE v6 AM61 was primarily used to dump everything with a PLEXTOR DVDR PX-716UF 1.11 used as a backup. More drives have since been acquired.
  
'''16.) Why do some builds post date the final release?''' <br>
+
'''16. Why do some builds post date the final release?''' <br>
 
This is not exactly known and the reasons can vary depending on the game. If the item in the lot is a build that predates a certain release but post dates others, then that build can be determined as a ‘localization’ or in progress revisional build. Some final builds were possibly altered to include protection so that they could only function on certain console models (like developer consoles). In some scenarios, the build could also be an unreleased second revision.
 
This is not exactly known and the reasons can vary depending on the game. If the item in the lot is a build that predates a certain release but post dates others, then that build can be determined as a ‘localization’ or in progress revisional build. Some final builds were possibly altered to include protection so that they could only function on certain console models (like developer consoles). In some scenarios, the build could also be an unreleased second revision.
  
'''17.) Why do some of the filenames in the lot have the wrong identifier/system (i.e “PSX” when the item is meant for “PS2”)?'''
+
'''17. Why do some of the filenames in the lot have the wrong identifier/system (i.e “PSX” when the item is meant for “PS2”)?''' <br>
 
Some of the items in the lot were initially misidentified by the archiver for a certain system (usually because the game in question was a multiplatform release). Due to the process of evaluating the items in the lot, we had to leave the original identifiers in.
 
Some of the items in the lot were initially misidentified by the archiver for a certain system (usually because the game in question was a multiplatform release). Due to the process of evaluating the items in the lot, we had to leave the original identifiers in.
  
'''18.) Were there some items that couldn’t be archived? What’s going on with them?'''
+
'''18. Were there some items that couldn’t be archived? What’s going on with them?''' <br>
 
At this point there are a few things in the lot that could be only partially archived due to the state of the media itself. We’re in the process of redumping those items and will try to get them out in the future. If a successful dump cannot be made, we will release the best possible dump and make note of it.
 
At this point there are a few things in the lot that could be only partially archived due to the state of the media itself. We’re in the process of redumping those items and will try to get them out in the future. If a successful dump cannot be made, we will release the best possible dump and make note of it.
 +
 +
'''19. Is anything up for sale?''' <br>
 +
No. At this time, everything is going back into storage.
 +
 +
'''20. Is this a leak?''' <br>
 +
No, all of these were sourced from old physical media, usually given out to old defunct magazines or old estate sales.
 +
 +
'''21. I can’t run any of these games in an emulator. Can I get support?''' <br>
 +
No. Please do not bother emulator developers in regards to anything in this lot. They most likely will not help you.
  
 
== Resources: ==
 
== Resources: ==
 
* [[News/Project Deluge: PlayStation 2|Project Deluge: PlayStation 2 (Initial Announcement Article) (March 20, 2021)]]
 
* [[News/Project Deluge: PlayStation 2|Project Deluge: PlayStation 2 (Initial Announcement Article) (March 20, 2021)]]
* [https://tcrf.net|The Cutting Room Floor (TCRF)]
+
* [[News/Project Deluge: PlayStation 1, Saturn, and CD-I (Part 2)|Project Deluge: PlayStation 1, Saturn, and CD-i (April 17, 2021)]]
* [https://archive.org|Internet Archive (IA)]
+
* [[Project Deluge: Xbox and Dreamcast|Project Deluge: Xbox and Dreamcast (September 18, 2021)]]
 +
* [https://tcrf.net The Cutting Room Floor (TCRF)]
 +
* [https://archive.org Internet Archive (IA)]

Latest revision as of 14:39, September 18, 2021

Project Deluge Logo.png



Project Deluge is an ongoing project to archive and assess all of the items featured in a lot of video game development material that has been gathered over the course of many years. This has been made possible through the dedication of only one extremely kind individual, who has taken on the herculean task of dumping every single thing in the lot by themselves.

Each item in the lot was assessed by a team of dedicated individuals for playability and integrity on both software (via emulation) and hardware when necessary. Each item was then lightly documented and given a general overview of some of the main interesting facts about the item in question.

Project Members
Iniche Researcher / Lead / Catalogue
Jason Scott Archive.org / Hosting
Master Emerald Artist
drx Researcher / Script Writing
ehw Researcher / Lead
Sazpaimon Researcher / Script Writing / Streamer
Zoda-Y13 Researcher
GopherGirl Researcher
Xkeeper Researcher (TCRF)
Rusty Researcher (TCRF)
Shoemanbundy Researcher
Hwd45 Researcher
SolidSnake Researcher
DigitalWarrior Researcher
Nex Researcher
Drac Researcher


Last Updated: September 18, 2021

  • Changelog:
    • September 18, 2021: Released Xbox and Dreamcast prototypes. Added more recently discovered final PS2 discs.
    • April 17, 2021: Released PlayStation, Saturn, and CD-i prototypes.
    • March 20, 2021: Initial release, added PlayStation 2 and some related asset discs.



Microsoft Xbox Prototypes

Project Deluge - Microsoft Xbox.png

The majority of the items featured in this lot are mastered on recordable media such as CD-Rs and DVD-Rs that are prone to deterioration with time. The bulk of the items from this lot were dumped using either PowerISO and CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well. Discs can be mastered in various different ways. Most were mastered with a blank DVD-Video partition followed by an Xbox game partition, some were mastered with just a single Xbox partition, and few were mastered with a normal UDF partition.

Builds

Due to the sheer number of discs, we've split the builds into two lists:

(Last Updated: September 18, 2021)

Sega Dreamcast Prototypes

Project Deluge - Sega Dreamcast.png

All of the items featured in this part of the lot are stored on GD-Rs, recordable media that are prone to deterioration with time. The bulk of the items from this lot were dumped on an actual Sega Dreamcast console with a System Disc 2 (required for reading GD-Rs on retail hardware) and Dreamcast SD Rip.

Builds

Due to the sheer number of discs, we've split the builds into two lists:

(Last Updated: September 18, 2021)

Sony PlayStation 2 Prototypes

Project Deluge - Sony Playstation 2.png

The majority of the items featured in this lot are mastered on recordable media such as CD-Rs and DVD-Rs that are prone to deterioration with time. The bulk of the items from this lot were dumped using either PowerISO and CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well.

Builds

Due to the sheer number of discs, we've split the builds into two lists:

(Last Updated: September 18, 2021)

Sony PlayStation Prototypes

Project Deluge - Sony Playstation.png

The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot were dumped using either PowerISO and CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well.

Builds

Due to the sheer number of discs, we've split the builds into two lists:

(Last Updated: April 17, 2021)

Sega Saturn Prototypes

Project Deluge - Sega Saturn.png

The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot were dumped using either PowerISO and CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well.

Builds

Due to the sheer number of discs, we've split the builds into two lists:

(Last Updated: April 17, 2021)

Philips CD-i Prototypes

Project Deluge - Philips CD-i.png

The majority of the items featured in this lot are mastered on recordable media such as CD-Rs that are prone to deterioration with time. The bulk of the items from this lot were dumped using either PowerISO and CloneCD using a Memorex MRX-650LE v6 AM61 CD/DVD drive and a PLEXTOR DVDR PX-716UF drive as well.

Builds

Due to the sheer number of discs, we've split the builds into two lists:

(Last Updated: April 17, 2021)

Assets

Project Deluge - Assets.png

This part of the lot contains various miscellaneous assets, such as source code, press releases, screenshots, video clips, and backups. Assets can be for strictly media/publication use or can be developer backups. This section might be broken down if more is discovered.

Click here to see the current list of assets. Current total: 2
(Last Updated: March 20, 2021)

FAQ

1. How can I help with Project Deluge?
Create an account on Hidden Palace and/or The Cutting Room Floor (TCRF) and help research the differences that can be found between each build and the equivalent final.

2. Where do the items featured in Project Deluge come from?
Various defunct media outlets, developers, and odds and ends from various collectors over a period of time. Every single item in the lot is currently being archived from the efforts of one single person and evaluated by a group of dedicated individuals.

3. What’s covered in Project Deluge?
Items that span across many console generations, from prototypes to various assets.

4. I believe I found an error that can cause issues running a game, how do I report it?
See answer to #5.

5. I found an error on one of the wiki page entries for an item in the lot, how should I correct it? Feel free to create an account on the wiki and make the necessary corrections. If you feel that a page needs to be renamed, please set up a redirect when moving the page so that the original page name can still be used to find the appropriate article.

6. Is there a release schedule?
As this is an actively on going project, there is no tentative release schedule. As soon as the parts of the lot that can be sorted into a set are archived, processed, and documented, a release will be soon to follow.

7. Where do final build dates come from? Where does release date information come from?
Final build dates are determined using the latest logical timestamp that can be found on the equivalent final. The timestamp is often found on the last modified file on the disc (as other parts of the metadata on the disc are often incorrect and post date the actual time the game was actually compiled/built). If timestamps are noticeably inaccurate, the next logical source for the date is used instead (such as the metadata). The final release data information was often sourced from GameFAQs which often lists more specific dates for various regions of the same game.

8. What is a composite checksum?
A composite checksum is the sum of the checksums for all the readable files on a disc image. Checksums for individual files on a disc image are calculated using a checksum algorithm that isn’t susceptible to collisions. The individual file checksums are then added together to create a unique checksum value that reflects the files themselves, rather than the entire disc image file itself. This way, changes in the files on the disc can be indicated by changes in the composite checksum value when comparing similar builds based on the same title in the pursuit of finding matches. A composite checksum is useful in the event that changes on the disc image occur that do not affect the physical data on the disc, like metadata and mastering differences. It’s also useful for determining small changes in files if other parts of the disc are comparable to other builds (useful for determining watermarks).

9. How are the items featured in the lot evaluated?
A custom tool was used to generate metadata from each disc from various data sets, such as composite checksums, main executable checksums, volume modification dates, disc metadata etc. The collected data is then gathered into a single spreadsheet where the same information that can be taken from the items in the lot can be compared to. If the composite checksum of an item in the lot matches against a data generated from a non pre-production part of the Redump set, then the files on that particular disc is the same as a final build. If the main executable checksum matches the main executable checksum from one of the data sets but the composite checksum doesn’t match, the item would then be manually checked against the partially matched builds to determine what differs between the builds. This is where builds that were watermarked, builds that have small inconsequential changes (like a small change in SYSTEM.CNF for PlayStation builds), and builds that contain obvious errors can be identified. These changes have been documented in the subsequent matched build pages for each system in the lot. The changes mentioned on these pages are enough to replicate the alterations that make up the build perfectly. If none of the data assessed from the item matches any part of the collected data sets, then that particular item is classified as non-final.

10. I want to research a particular item from the lot, how should I go about sharing the information I’ve discovered?
See answer to question #1 and #5.

11. Are the items in the lot free from errors or defects caused during the archival process?
There are no guarantees that each dump is free from errors. All the prerelease items were often authored on recordable media that was not meant to last indefinitely. For older items, especially ones authored on recordable optical media, the items were often mastered using duplicators that introduced further errors that could have been baked into each copy of the duplicated disc. Normally we would archive discs using the best methods available, but given the circumstances surrounding the lot itself, this wasn’t readily available in time for some of the items in the lot. We attempted to rigorously test and analyze each disc and note errors wherever possible. As such, we would rather have some dump than no dump at all.

12. How were disc errors determined?
After determining that an item in the lot is producing a unique checksum value that doesn’t match anything on Redump or on our wiki, if copies of an item exist in the same lot - errors can be determined by comparing where the changes lie between the two copies. If one copy is filled with filler bytes due to the drive not being able to read sectors, then that copy contains errors. If the item in the lot is an optical disc using ISO 9660 (such as CD-Rs), errors can be determined by checking the EDC/ECC data written with the data on the same disc. For these, we used an open source tool called edccchk, an EDC/ECC checker for RAW (2352 bytes/sector) CD images, to locate and interpret errors. If the errors are correctable using the included data or that the errors in question do not directly affect the files on the disc, then the item is good enough for release.

13. How are items with protection handled?
If an item is determined to be utilizing protection (such as ‘dongle’ protection), we made attempts to create an .xdelta patch so you can patch the protection out of the original dump. To apply an .xdelta patch, you can use a tool like Delta Patcher on the original image.

14. Why are there multiple copies of a particular item in the same lot?
Most review and preview builds aren’t mastered with unique builds and were usually produced in mass and sent to various media outlets. The only thing that can be unique between each copy is certain metadata and/or changes to help identify a build. These changes have been documented in the subsequent matched build pages for each system in the lot.

15. What hardware and software was used to archive the items in the lot?
For disc images, a combination of PowerISO and CloneCD was used to dump every CD/DVD in the lot initially. A Memorex MRX-650LE v6 AM61 was primarily used to dump everything with a PLEXTOR DVDR PX-716UF 1.11 used as a backup. More drives have since been acquired.

16. Why do some builds post date the final release?
This is not exactly known and the reasons can vary depending on the game. If the item in the lot is a build that predates a certain release but post dates others, then that build can be determined as a ‘localization’ or in progress revisional build. Some final builds were possibly altered to include protection so that they could only function on certain console models (like developer consoles). In some scenarios, the build could also be an unreleased second revision.

17. Why do some of the filenames in the lot have the wrong identifier/system (i.e “PSX” when the item is meant for “PS2”)?
Some of the items in the lot were initially misidentified by the archiver for a certain system (usually because the game in question was a multiplatform release). Due to the process of evaluating the items in the lot, we had to leave the original identifiers in.

18. Were there some items that couldn’t be archived? What’s going on with them?
At this point there are a few things in the lot that could be only partially archived due to the state of the media itself. We’re in the process of redumping those items and will try to get them out in the future. If a successful dump cannot be made, we will release the best possible dump and make note of it.

19. Is anything up for sale?
No. At this time, everything is going back into storage.

20. Is this a leak?
No, all of these were sourced from old physical media, usually given out to old defunct magazines or old estate sales.

21. I can’t run any of these games in an emulator. Can I get support?
No. Please do not bother emulator developers in regards to anything in this lot. They most likely will not help you.

Resources: