Working with very large files

News & Announcements Updates and Changes
1

Running DIAMOND and MEGAN on very large files of reads can be challenging, e.g. when faced with time restrictions for a single job on a server.

To address this, divide your input file into multiple parts. Run each part separately through DIAMOND and meganizer.

Then use the new MEGAN tool merge-files to logically merge the set of meganized .DAA files into a single .MEGAN file. You can work with this file in MEGAN as if it contained all the input reads and their alignments. Under the hood, MEGAN iterates over all the input .DAA files when it needs to access the underlying data.

This is a new feature, available in release 6.23.

1 Like
2

Is this tool merge-files still available in 6.25.9?

3

It should be available in your Megan installation tools directory.

MEGAN-Installation-dir/tools/merge-files

4

I tried merge-files on a server and on my Mac, but neither attempt was successful due to a ‘Permission denied’ error.

Here is the command I tried on my Mac:
/Applications/MEGAN_6.25.9/tools/merge-files -h
zsh: permission denied: /Applications/MEGAN_6.25.9/tools/merge-files

I used MEGAN 6.25.9 Community Edition.

5

There seems to be a permission issue on your Mac. You can try using the wildcard chmod 777 /Applications/MEGAN_6.25.9/tools/merge-files and then try again. However, please note that this command will open up all permissions.