[jdom-interest] How to manipulate a very large XML file? Any suggestions?

[Goswami, Raj]

If you have a need to provide a generic solution, how would you go about
that?  If I understand correctly, even XQuery uses XPath internally.
Doesn't that require it to create the whole document in memory?  How does
the commercial vendors manage this (like Mercator, Vitria etc.) for document
translation?

Thanks, 

Raj Goswami 
(410)613-6288 



-----Original Message-----
From: Elliotte Rusty Harold [mailto:elharo at metalab.unc.edu]
Sent: Tuesday, February 10, 2004 8:04 AM
To: Jason Hunter
Cc: Goswami, Raj; 'jdom-interest at jdom.org'
Subject: Re: [jdom-interest] How to manipulate a very large XML file?
Any suggestions?


At 11:06 AM -0800 2/9/04, Jason Hunter wrote:
>I use XQuery.  The language lets you do amazing things with XML and 
>if you can get the right implementation it can be extremely fast. 
>In my day job I'm able to quickly extract data from gigs of XML to 
>produce reports.  This of course relies on an indexed engine (not 
>just reading off the filesystem).
>

The *language* isn't that incredible. It doesn't let you do anything 
that couldn't be done with XSLT. What you're really suggesting is 
using a file-backed data store for situations where the document size 
exceeds available memory. However, this could also be done with SQL 
and a relational database or a custom file format written in Java. 
Which is most appropriate depends a lot of the details of the project.
-- 

   Elliotte Rusty Harold
   elharo at metalab.unc.edu
   Effective XML (Addison-Wesley, 2003)
   http://www.cafeconleche.org/books/effectivexml
 
http://www.amazon.com/exec/obidos/ISBN%3D0321150406/ref%3Dnosim/cafeaulaitA
_______________________________________________
To control your jdom-interest membership:
http://lists.denveronline.net/mailman/options/jdom-interest/youraddr@yourhos
t.com