ReleasePlanning
From SPCTools
(Difference between revisions)
| Revision as of 21:33, 18 April 2014 JoeS (Talk | contribs) (→4.7.1 Release) ← Previous diff |
Revision as of 22:05, 18 April 2014 Luis (Talk | contribs) (→4.7.1 Release) Next diff → |
||
| Line 55: | Line 55: | ||
| * SpectraST appears to have a 2 GB library limit on Windows? Linux not tested. | * SpectraST appears to have a 2 GB library limit on Windows? Linux not tested. | ||
| ** Some attempts to build a library larger than 2 GB fails. Some attempts succeed but then a search yields an error that the index is bad. Perhaps it works fine on 64-bit Linux and/or 64-bit Windows?? | ** Some attempts to build a library larger than 2 GB fails. Some attempts succeed but then a search yields an error that the index is bad. Perhaps it works fine on 64-bit Linux and/or 64-bit Windows?? | ||
| - | |||
| - | * When you click [Paste] files, there's no feedback that Petunia is doing something. Not an issue for small files, but for large files, this is puzzling to new users.. maybe little JS widget to give some feedback? | ||
| * Joe proposed a new idea where if the code is running on Amazon, then in addition to a [Log Off] button, also provide a [Save data and shutdown] button within Petunia. The current TWA [Stop Instance] button would become more of an [Immediate Kill] button with a JS warning that you may lose work because of this. | * Joe proposed a new idea where if the code is running on Amazon, then in addition to a [Log Off] button, also provide a [Save data and shutdown] button within Petunia. The current TWA [Stop Instance] button would become more of an [Immediate Kill] button with a JS warning that you may lose work because of this. | ||
| * Add all modern instance types to TWA | * Add all modern instance types to TWA | ||
| - | |||
| - | * Add to Petunia the option to give proper probabilities to decoy hits | ||
| * We should really distribute some modern fasta databases with TPP data instead of ancient IPI dinosaurs | * We should really distribute some modern fasta databases with TPP data instead of ancient IPI dinosaurs | ||
| Line 71: | Line 67: | ||
| * Review the state of and get ready to submit the TPP AWS paper! | * Review the state of and get ready to submit the TPP AWS paper! | ||
| - | |||
| - | * Luis proposes to replace the current [Analyze Peptides] etc. tabs with simpler interface where the user chooses which steps to perform and in what order. This not only simplifies the page, but could also double as a very simple workflow manager. Selected options would be saved to a simple params file of key-value pairs that would be read by a new runtpp program that would launch tools with the appropriate parameters | ||
| * We should synch as closely as possible how data for the example datasets looks on the EC2 nodes and local installations | * We should synch as closely as possible how data for the example datasets looks on the EC2 nodes and local installations | ||
| Line 88: | Line 82: | ||
| * Update the pepXML viewer so that it notices if its temp index file parts written in TEMPDIR fail for whatever reason, and provides a nice error message that points to the real problem. “Perhaps the disk that hosts TEMPDIR ($TEMPDIR) is full?” | * Update the pepXML viewer so that it notices if its temp index file parts written in TEMPDIR fail for whatever reason, and provides a nice error message that points to the real problem. “Perhaps the disk that hosts TEMPDIR ($TEMPDIR) is full?” | ||
| - | * Petunia make sure that optional output files do not contain spaces! | + | ==== Completed ==== |
| - | * Petunia should automatically create /dbase/speclibs if it doesn't exist when attempting to download libraries instead of failing | + | * Fixed PERL_BIN issue on Linux builds/installations |
| - | ==== Completed ==== | + | * ''Added feedback in form of a color change when clicking the Paste button'' :: When you click [Paste] files, there's no feedback that Petunia is doing something. Not an issue for small files, but for large files, this is puzzling to new users.. maybe little JS widget to give some feedback? |
| - | * Fixed PERL_BIN issue on Linux builds/installations | + | * ''Added'' :: Add to Petunia the option to give proper probabilities to decoy hits |
| + | |||
| + | * ''Done'' :: Petunia make sure that optional output files do not contain spaces! | ||
| + | |||
| + | * ''User is warned to create target directory before attempting to download; Download button is also deactivated'' :: Petunia should automatically create /dbase/speclibs if it doesn't exist when attempting to download libraries instead of failing | ||
| == Miscellaneous Ideas == | == Miscellaneous Ideas == | ||
Revision as of 22:05, 18 April 2014
This page is intended to assist in release planning by tracking new feature requests/bugs/improvements etc for TPP.
Contents |
4.8.0 Release
- Release date: ??
Proposed
- Redo Apache configuration file setup.
- Its very out of date
- Incompatible with Apache 2.4 (as found in Ubuntu)
- Hard to deploy/maintain
- Doesn't use web application conventions (single file in available-sites)
- Consider signing the windows installer so it doesn't say publisher unknown on the UAC dialog. (see https://www.google.com/search?q=signtool.exe&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a&channel=rcs)
- (Joe) Try building both 64 bit and 32 bit
- (Joe) Include documentation on how to configure sudo/SGE for petunia
- (Eric+Joe+Steve) NEW FEATURE: Bundle idConvert, Petunia page, Steven is fixing it and working with Matt
- (Joe) NEW FEATURE: Add ability to include CPAN modules in TPP installer for AMZTPP
- (Joe) NEW FEATURE: Include amztpp in the distribution using new CPAN module installer
- (Joe) IMPROVEMENT/BUG: Have the TPP installer fill in the correct paths in tpp_gui.pl when building. Warn if a program can't be found. On Windows it seems to have a hardcoded path to perl so that the programs/cgi scripts fail if you put perl in another location, e.g. installing 64 bit perl which goes to C:\Perl64 instead of C:\Perl. Recently tried the 64 bit version and found that the installer throws ugly perl errors in the installation. The cgi scripts however seem to work.
- (Luis) NEW FEATURE: Support of OMSSA and hrk-score in the Petunia, prophets, quant, viewers
- (Joe+Luis) NEW FEATURE: Create a centralized path furnishing system
- (Luis/Joe) BUG: lorikeet uses hardcoded paths to the html and javascript directories on the Apache server (e.g. ISB/js/lorikeet.js) instead of using the TPP_WEB Makefile variable.
- (Luis) NEW FEATURE: Provide a db fmt/verifier that gets run as an optional first step in petunia
- (Joe) BUG: new decoy generator doesn't know about NCBI "|" so creates funny sequence ids
- Rewrite QualScore in portable C++ to retire Java
- Have a nightly Windows build
- Joe would love to rewrite the Make file
To Do
Completed
4.7.1 Release
- Release date: ASAP
Proposed
- SpectraST appears to have a 2 GB library limit on Windows? Linux not tested.
- Some attempts to build a library larger than 2 GB fails. Some attempts succeed but then a search yields an error that the index is bad. Perhaps it works fine on 64-bit Linux and/or 64-bit Windows??
- Joe proposed a new idea where if the code is running on Amazon, then in addition to a [Log Off] button, also provide a [Save data and shutdown] button within Petunia. The current TWA [Stop Instance] button would become more of an [Immediate Kill] button with a JS warning that you may lose work because of this.
- Add all modern instance types to TWA
- We should really distribute some modern fasta databases with TPP data instead of ancient IPI dinosaurs
- Figure out a multiple example datasets downloader tool
- Revisit the data warmstart strategy. course. tutorial. end-to-end. more!
- Review the state of and get ready to submit the TPP AWS paper!
- We should synch as closely as possible how data for the example datasets looks on the EC2 nodes and local installations
- We also discussed the idea of completely generalizing Joe’s mod of bgzip and calling it igzip (for indexed gzip) and giving it the potential to be widely used apart from mass spectrometry/mzML.
To Do
- Update to very latest comet
- PlotSpectraST is broken! Will not display any spectra when an mzML file is searched (perhaps mzXML is okay?)
- Luis will send David a PlotSpectraST repro
- Update the pepXML viewer so that it notices if its temp index file parts written in TEMPDIR fail for whatever reason, and provides a nice error message that points to the real problem. “Perhaps the disk that hosts TEMPDIR ($TEMPDIR) is full?”
Completed
- Fixed PERL_BIN issue on Linux builds/installations
- Added feedback in form of a color change when clicking the Paste button :: When you click [Paste] files, there's no feedback that Petunia is doing something. Not an issue for small files, but for large files, this is puzzling to new users.. maybe little JS widget to give some feedback?
- Added :: Add to Petunia the option to give proper probabilities to decoy hits
- Done :: Petunia make sure that optional output files do not contain spaces!
- User is warned to create target directory before attempting to download; Download button is also deactivated :: Petunia should automatically create /dbase/speclibs if it doesn't exist when attempting to download libraries instead of failing
Miscellaneous Ideas
List of suggested TPP new features, improvements, fixes, etc.. to be cherry picked for upcoming releases.
- MzXML2Search is used to convert mzML files to mgf for searching with OMSSA. Do we even need this program with the
capabilities of msconvert? Only ask as I have a set of files its crashing on right now and it works for msconvert...
- Drop CompactParser. Doesn't seem to work.
- Breakout apache configuration into its own file and handle it properly on Ubuntu systems
- (Luis?) IMPROVEMENT: This one goes to "11", or in this case 10. Charge states above +9 will no doubt cause trouble in TPP.
- NEW FEATURE: PEFF support in TPP. (Need to define what this means).
- 64 bit version of TPP? mingw-64 is stable now. http://mingw-w64.sourceforge.net
- Better support for viewing/outputting N15 experiments. Sequences are hard to read (modification every base) and makes the xml huge.
- Add ASAPRatio option to use WaveletQuant in Petunia
- Verify that xinteract can deal with this option (-w)
- Petunia: option to run xinteract jobs as separate (instead of combining into a single analysis)
- Make sure new installation of QualScore works on Windows
- Output more significant figs for Protein Prophet weight (rounding error on 0.49 and 0.50)
- Fix precursor charge column (only 1st letter displayed) and miscalculation of the # of unique peptides in EXCELPEPS
- EXCELPEPS appears to be broken; just remove it?
- Resolve Andreas issue with Tandem2XML
- Write (TPP) software version used in pepXML, protXML, etc
- Silence/catch errors on the *Prophet models generation when no data (e.g. "empty y range")
- Zhi has been experiencing a bus error one large operation with SpectraST
- There is a was a reported bug by Henry with mzParser
- Add commandline option to generate EXCEL output of pepXML files
- Issue with MzXML2Search converting older mzXML files to mgf. Randomly fails on the same file.
- Missing javascript file for table filtering in Petunia (only affects Linux installations)
- I encountered a small problem when using the new TPP. In the prot.shtml view, pink color coding of NxS/T motifs does not work anymore when checking the box. Also, I always liked the "464 peptides with NXS/T motif, 690 total peptides, 658 unique stripped peptides"info at the bottom of the page (as it gives us an immediate idea of how nicely a glyco experiment worked) but this is not displayed correctly anymore.
- Included Terry's latest version of Inspect2PepXML.py for patching inspect installations
- Bug: Petunia will (re-)submit a new job if the "back" button is clicked after the initial job launch (Windows only)
Legacy Items
Fix iProphet models page ("performance" models are missing)
- Add "Bruker" files option to msconvert in Petunia
- Fix pepxml2html (View Peptide hits) peptide link for SpectraST results
- peptidexmlhtml2 : does not work with AA highlighting option (mark_aa=)
- Add some filtering options to Pep3D (specifically: view only +1 ions)
- Add QuickMod to speclibs page?
- retire getSpectrum -> use readMzXML
- incorporate psm2pdf
- include t2d support(?)
- Petunia: option to convert to mzXML using msconvert
- Petunia: launch all external links in blank/target window
- Reindex mzXML: new file with old name; rename old to: old-index or some such
- Petunia: option to run xinteract jobs as separate (instead of combining into a single analysis)
- Petunia: select pep.xml files only for input to Decoy Models pages
- Petunia: auto cd to dir and strip out full path if all files in same dir (shorten command line)
- Petunia: rename Mascot file on download
- Move /tmp/ directory under tpp-bin (Windows)
- Petunia: Add TPP version check (ping server) --> usage stats
- Petunia: add full filters to msconvert(??)
- Petunia: change tab graphic when jobs are done?
- PepXMLViewer: implement "preferences" tab: choose ions series, spectrum viewer, etc... ?
- PepXMLViewer: no pep-pro probability link in iProphet results
- Libra also needs some love (ability to curate ratios would be a great start...)
== From Henry (perhaps he already checked this in?) :
Following up on this discussion, I would like to propose the following. (This is not urgent since our course doesn't use OMSSA or any of the newly-supported engines, so it doesn't need to be in the release soon.)
1. Change xinteract to run RefreshParser before PeptideProphet.
This takes care of the protein name issues for OMSSA, and makes sure that the NTT and NMC fields are there and calculated correctly for PeptideProphet. Some search engines don't fill in those fields and cause PeptideProphet to crash.
The flip-side is mainly inefficiency. If the user decides not to keep all search hits regardless of probability (i.e. not specifying -p0), then this means RefreshParser unnecessarily refresh a bunch of wrong identifications that won't be in the final pepXML file anyway. But then again, given that nowadays PeptideProphet often relies on the protein name (whether it's a DECOY or not), it seems safer to ensure that the protein names are right -- even for the wrong hits -- before we run PeptideProphet. Also, with the new implementation, for most files RefreshParser is so fast that I don't think it will make much difference in running time anyway.
If the user doesn't want to refresh, he/she can always turn off RefreshParser (-nR option).
2. Have InteractParser detects if the search engine is OMSSA, and if so, apply the fix_pyro_mods_ option automatically.
This goes without saying. The only thing is the user doesn't have to turn on the option manually. I don't know if other engines have the same problem. If so, it's easy to add them to the list.
