facebook

Large XML file editing

  1. MyEclipse IDE
  2.  > 
  3. General Development
Viewing 15 posts - 1 through 15 (of 21 total)
  • Author
    Posts
  • #259071 Reply

    walterw737
    Participant

    Hi, Guys:

    I am trying to open a more than 2M size xml file in MyEclipse XML Editor , I get 100% CPU, nearly 800M memory usage for Javaw.exe for almost half hour now, and xml file still not opened, is this usual? Is there anyway I can optimize on this?

    #259122 Reply

    Riyad Kalla
    Member

    Walter,
    Can you go to MyEclipse > Installation Summary > Installation Details and paste the result here for me? We were aware of big-XML problems in previous releases of MyEclipse, but those were fixed in 5.0 (hopefully… assuming of course you aren’t using 5.0)

    #259137 Reply

    walterw737
    Participant

    *** Date: Mon Sep 25 11:22:21 EST 2006

    *** System properties:
    OS=WindowsXP
    OS version=5.1
    Java version=1.6.0-beta2

    *** MyEclipse details:
    MyEclipse Enterprise Workbench

    Version: 5.0 GA
    Build id: 20060805-5.0-GA

    *** Eclipse details:
    MyEclipse Enterprise Workbench

    Version: 5.0.1 GA
    Build id: 20060810-5.0.1-GA

    Eclipse Project SDK

    Version: 3.2.0.v20060609m-GNq6oQq-7es-Y81
    Build id: M20060629-1905

    Eclipse Platform

    Version: 3.2.0.v20060609m-AgOexn6hlEUsvBO
    Build id: M20060629-1905

    Eclipse Plug-in Development Environment

    Version: 3.2.0.v20060609m——6zXJJzJzJq
    Build id: M20060629-1905

    Eclipse RCP

    Version: 3.2.0.v20060609m-SVDNgVrNoh-MeGG
    Build id: M20060629-1905

    Eclipse Java Development Tools

    Version: 3.2.0.v20060609m-F7snq1fxia-Z4XP
    Build id: M20060629-1905

    Eclipse Graphical Editing Framework

    Version: 3.2.0.v20060626
    Build id: 20060627-0816

    Eclipse startup command=-os
    win32
    -ws
    win32
    -arch
    x86
    -launcher
    D:\eclipse\eclipse.exe
    -name
    Eclipse
    -showsplash
    600
    -exitdata
    598_7c
    -product
    com.genuitec.myeclipse.product.ide
    -vm
    C:\WINNT\system32\javaw.exe

    #259143 Reply

    Riyad Kalla
    Member

    Could you install JDK 1.5.0_08 (uncheck the JRE during the installation to avoid installing the JRE) then using the -vm command line argument to launch MYEclipse with JDK’s javaw.exe executable?

    Also you might want to adjust your command line arguments to match the ones given here to improve performance of MyEclipse:
    http://www.myeclipseide.com/PNphpBB2+file-viewtopic-t-10087.html

    #259145 Reply

    walterw737
    Participant

    Actually the command arguements are already added in, I will try the VM then.
    Thanks, You guys are really legend.

    #259148 Reply

    walterw737
    Participant

    Hi, Riyad:

    Still the same, I’ve been waiting for more than 2 hours to open the xml file, it’s still hanging with 100% CPU usage. Can you open such a large xml file in your enviroment?

    Thanks

    #259166 Reply

    Riyad Kalla
    Member

    Wow… is there any way you can share this file specifically with us? I can erase it after we are done testing, but I’d like to know specifically what is going on.

    We had a “cannot open huge files” bug a while ago and have a test XML file attached to that bug that I test with and it works fine… so I think there is something special about this file.

    #259233 Reply

    walterw737
    Participant

    Hi, Riyad:
    How do I send the file to you then?

    #259234 Reply

    Riyad Kalla
    Member

    Woops, please email it to support@genuitec.com ATTN Riyad, with a link to this thread so I know why I’m getting the file.

    #260133 Reply

    tenjin
    Member

    Hi,

    I second this bug.

    It thrashed my processor so bad the fans came on full….

    It’s completely unusable, even with all validation turned off.

    Any ideas?

    Cheers

    Darren.

    #260138 Reply

    Riyad Kalla
    Member

    Darren,
    A key is to give us a reproducable test case that we can file as a bug and assign to the development team to work on. Over time people have submitted troublesome files to us and we use them all to uncover bugs (sometimes it can be a particular issue, like parsing UTF-8 characters that cause the whole deal to popup).

    For starters, can you paste your system information from MyEclipse > Installation Summary > INstallation Details for me?

    #260140 Reply

    tenjin
    Member

    Hi,

    The XML file is confidential I’m afraid so I can’t post it. However, I can say that it is 1.5Mb and UTF-8 encoded. It is also well formed and valid.

    Here is the installation log:

    *** Date: Tue Oct 10 21:02:12 BST 2006

    *** System properties:
    OS=WindowsXP
    OS version=5.1
    Java version=1.5.0_08

    *** MyEclipse details:
    MyEclipse Enterprise Workbench

    Version: 5.0 GA
    Build id: 20060805-5.0-GA

    *** Eclipse details:
    Eclipse SDK

    Version: 3.2.0
    Build id: M20060629-1905

    Eclipse Platform

    Version: 3.2.0.v20060609m-AgOexn6hlEUsvBO
    Build id: M20060629-1905

    Eclipse RCP

    Version: 3.2.0.v20060609m-SVDNgVrNoh-MeGG
    Build id: M20060629-1905

    Eclipse Java Development Tools

    Version: 3.2.0.v20060609m-F7snq1fxia-Z4XP
    Build id: M20060629-1905

    Eclipse Plug-in Development Environment

    Version: 3.2.0.v20060609m——6zXJJzJzJq
    Build id: M20060629-1905

    Eclipse Project SDK

    Version: 3.2.0.v20060609m-GNq6oQq-7es-Y81
    Build id: M20060629-1905

    Eclipse Graphical Editing Framework

    Version: 3.2.0.v20060626
    Build id: 20060627-0816

    Eclipse startup command=-os
    win32
    -ws
    win32
    -arch
    x86
    -launcher
    D:\Program Files\eclipse\eclipse.exe
    -name
    Eclipse
    -showsplash
    600
    -exitdata
    2c0_74
    -vm
    C:\WINDOWS\system32\javaw.exe

    Regards

    Darren.

    #260142 Reply

    tenjin
    Member

    Hi,

    This is the command line I use to start Eclipse:

    “D:\Program Files\eclipse\eclipse.exe” -vmargs -Xms128M -Xmx512M -XX:PermSize=64M -XX:MaxPermSize=128M

    Regards

    Darren.

    #260143 Reply

    Riyad Kalla
    Member

    Darren,
    Setup and command line args all look good. As far as the file goes, can you explain what happens. When you open it, the reconciler runs forever? If you run validation it gets stuck on the file? If you type it’s super slow?

    If you can point out very specifically what the problem is, I can point the finger of blame on my end at certain components that may need a critical looking-at by the development team. That way we can do our best without the file in question.

    #260145 Reply

    tenjin
    Member

    Hi,

    No problem.

    Create a new General project
    Import a 1.5Mb UTF-8 encoded XML file
    Double click on the XML file to open it
    – Control never returns to Eclipse
    – Processor goes to 100% and stays there
    – javaw memory usage climbs significantly
    – Eclipse can only be closed by terminating the “javaw” process in Task Manager. Requests to close Eclipse through applications in Task Manager don’t work.

    The same behaviour can also be seen if you create an empty XML file in Eclipse, then paste in 1.5Mb of XML from the clipboard.

    The only thing that distinguishes this XML file from others is that it contains a few characters that are not in the Windows 1252 Latin-1 codepage, namely a “tm” symbol. Not sure if that is an issue, but it’s the only thing I can see that is different from every other XML file.

    Regards

    Darren.

Viewing 15 posts - 1 through 15 (of 21 total)
Reply To: Large XML file editing

You must be logged in to post in the forum log in