Hi @wjung,
You will need more RAM to handle this issue. One possible solution is to split your raw FASTQ files into chunks and run DIAMOND+MEGAN on each chunk. Finally, you can merge them using the MEGAN tool’s merge-files function. The logic is explained here: Working with very large files.
However, merging may also require more RAM, but it’s worth trying.
Anupam