September 2012 - Chimera-dev - RBVI Mailing Lists

Re: [chimera-dev] Chimera/Python sparse matrices
by Greg Couch 06 Dec '13

06 Dec '13

On 8/13/2010 12:06 PM, Forbes J. Burkowski wrote: > What are the steps that need to be taken if the Python used in Chimera is > to have the ability to import functions from SciPy or PySparse? > > Thanks for any advice that you can provide. > > Cheers, > Forbes Burkowski If you want to use prebuilt SciPy binaries with chimera, you need one that is compatible with the version of chimera that chimera is using. Chimera 1.4.x uses Python 2.5, and the daily builds use Python 2.7. You would add those packages to chimera by either (1) given the '--pypath dir' command line option, (2) setting your CHIMERAPTH environment variable (instead of PYTHONPATH, PYTHONPATH is ignored so chimera won't be accidentally broken by other installed Pythons), or (3) add the installation directory to sys.path in Python. If you're not using a daily build on Linux, then you should edit CHIMERA/share/chimeraInit.py and comment out or remove the part that sets the RTLD_GLOBAL flag -- it appears to be no longer needed and its presence breaks SciPy. If you're going to compile from source, which you'll need to do if you're using a daily build, I'd recommend trying PySparse first, since it is a smaller package. Python packages that incorporate C (or C++ or Fortran) code are more difficult than prebuilt binaries because (a) you need a compiler, and (b) if the code calls the Python C API, you need a compatible compiler, ideally the same one as what the rest of Chimera was build with. PySparse needs BLAS and LAPACK libraries and optionally wants UMFPACK and/or SuperLU. On on Redhat and Fedora Linux, you can get the first three libraries by installing the blas-devel, lapack-devel, and suitesparse-devel packages. Chances are you'll be able to install PySparse into chimera's python by running "CHIMERA/bin/pythonXXX setup.py install" in the pysparse source tree (where CHIMERA is the path to where chimera was installed). On Linux, you might have to set the LD_LIBRARY_PATH environment variable to CHIMERA/lib. On Mac OS X, the path to the chimera binary is CHIMERA/Contents/Resources/bin/pythonXXX and the environment variable is DYLD_LIBRARY_PATH. Or you could install PySparse into another Python and use the --pypath/CHIMERAPATH/sys.path approach as given above. Hope this helps, Greg

4 3

Re: [chimera-dev] [Chimera-users] Amber Force Field
by Tom Goddard 17 Oct '12

17 Oct '12

Hi Forbes, I think Eric and Conrad may no more about your problem than I do. But I can tell you my best guess why your calculation is abysmally slow. I think the basic trouble is that useRotamer() decides to replace the existing residue rather than simply update its coordinates. In other words it deletes the old side chain atoms and bonds and makes new ones. Then the new ones don't have charges assigned for energy calculation. So the minimize "prep" option adds hydrogens and computes charges. It does this for the entire molecule because it doesn't know how to prep just one atom. So for each residue and each rotamer tried you end up adding hydrogens and recomputing charges for the whole molecule. Turning prep off in the minimize() call will just cause an error because the charges are missing. The "cache" option in the minimize() call also won't work because the molecule has changed. In fact the minimize code is not smart enough to realize the molecule has new atoms and will try to use the cached MMTK copy of the former molecule and this will probably lead to errors (as you describe). So my 30 minute look at the various parts of the Chimera code without any testing suggests the slowness is because hydrogens/charges are recomputed for every rotamer. The new MMTK molecule object is just the one residue you are calculating the energy of. You realize your code does not take account of any interactions of that residue with any other residues. The other residues are completely ignored. That is what exclres means. So you may as well be asking for the energy of a one residue molecule starting in the rotamer configuration with the actual residue backbone atom positions. I bet this would be very much faster if using a rotamer simply changed existing atom coordinates, then you add hydrogens and charges just one time for all the calculations, and you can cache the MMTK molecule object for each single residue energy calculation which will speed up calculating the different rotamer energies for that residue. Eric is the one who would know why the useRotamer() code deletes atoms and adds new ones instead of just changing the coordinates. It would probably be pretty easy to make a new routine to use instead of useRotamer() that simply copied atom coordinates from the rotamer molecules returned by getRotamer() to the original molecule. Or what about just calculating the energy of the rotamer molecules directly without trying to put them into the protein (with all its other residues ignored)? I see when I use the Rotamer dialog and hide the original molecule that the returned rotamers include CA and N backbone atoms but not C, O. Tom > Hi Tom: > > Thanks for your email of May 4. After some experimenting I got the code > to work but the execution times are deplorable! As I indicated earlier I > want to use the Amber energy calculations to compare various confirmations > involving different rotamers. My problem seems to be that I cannot get a > fast execution because I am unable to cache the results of various > computations and I believe the calculations are starting from scratch for > each rotamer combination. Here is a simplified version of the code that I > am using (in this case working with only one rotamer and essentaily > computing its intrinsic energy (I hope)): > > import chimera > import Rotamers > from Rotamers import getRotamers, useRotamer, NoResidueRotamersError > from MMMD import base > > > def evaluateAmberEnergy(res_L, prot): > > fixedAtoms = set() > molecules = list([prot]) > usingResidues = set(res_L) > > exclres = set(sum((m.residues for m in molecules), [])) > exclres.difference_update(usingResidues) > > def run(minimizer): > minimizer.run() > > minimizer = base.Minimizer(molecules, nsteps=0, stepsize=0.02, > cgsteps=0, cgstepsize=0.02, interval = 10, > fixedAtoms=fixedAtoms, nogui=True, > addhyd=True, callback=run, > exclres=exclres, cache=False, prep=True) > > energy = minimizer._mi.universe.energy() > print "energy value: ", energy > return energy > > #========================================================================== > > # Global variable: > prot = chimera.openModels.open("1CRN", type="PDB")[0] > > for rc in prot.residues: > rotCur_L = getRotamers(rc)[1] > for rotC in rotCur_L: > useRotamer(rc, [rotC]) > energyAmber = evaluateAmberEnergy([rc], prot) > print rc.type, rc.id.position, energyAmber > > > > This is producing a lot of text in the Python Shell and when the program > is run with a large protein it will go for hours... > > Any suggestions for speeding this up would be greatly appreciated. I > tried different settings of cache and prep but got Chimera errors such as > missing C++ atom objects. > > Depressing.... > > Best regards, > Forbes > > > > > > On Fri, 4 May 2012, Tom Goddard wrote: > >> Hi Forbes, >> >> If you want to get the minimized energy within your Python script >> then you need to run the minimization using a Python function call >> rather than a Chimera text command. To figure out how to do that I look >> at the Python code that is called by the Chimera text command in your >> Chimera distribution >> >> chimera/share/MMMD/cmdline.py >> >> or also available online >> >> >> http://plato.cgl.ucsf.edu/trac/chimera/browser/trunk/libs/MMMD/cmdline.py >> >> The minimize() Python function is called using the text command >> arguments. I see it basically does >> >> from MMMD import base >> minimizer = base.Minimizer(molecules, nsteps, stepsize, cgsteps, >> cgstepsize, interval, >> fixedAtoms, memorize, nogui, addhyd, lambda m: >> m.run(), exclres, cache, prep) >> >> Looking at base.py in the same directory and tracking back from where >> "Initial energy..." is printed in file MMTKinter.py I see the energy is >> obtained using >> >> minimizer._mi.universe.energy() >> >> I have not tested this out but perhaps it will move you in the direction >> you want to go. >> >> Tom >> >> >>> Hi: >>> >>> Thanks for the response. The code that you suggested seems to work. I am >>> getting the initial energy reported in the Python Shell along with other >>> lines that are reporting on the activities of the command. >>> >>> Since I am embedding this command in a runCommand statement, I would like >>> to get the initial energy value put into a variable within the Python >>> script instead of the Python Shell window. Is there any way to accomplish >>> this? >>> >>> Cheers, >>> Forbes >>> >>> >>> On Fri, 13 Apr 2012, Elaine Meng wrote: >>> >>>> Hi Forbes, >>>> The minimization tool reports the total energy, not any breakdown into components (electrostatic, VDW, strain) or interactions between sets of atoms. However, the "minimize" command has a "fragment" option for ignoring all but the specified residues, so you could at least limit what is considered the total system. That also makes the calculation faster, although single-point energy calculation (0 steps minimization) should already be pretty fast. >>>> Best, >>>> Elaine >>>> >>>> Example (and see also "nogui true"): >>>> >>>> minimize spec :13.a,17.a fragment true cgsteps 0 nsteps 0 >>>> >>>> <http://www.cgl.ucsf.edu/chimera/docs/UsersGuide/midas/minimize.html> >>>> >>>> On Apr 13, 2012, at 10:38 AM, Conrad Huang wrote: >>>> >>>>> Chimera's "Structure Editing -> Minimize Structure" tool (or the "minimize" command) may be used to do this. The tool reports the initial energy of the system in the Reply Log. If you give zero as the number of steps for both steepest descent and conjugate gradient minimization, then Chimera should return immediately. >>>>> >>>>> Conrad >>>>> >>>>> On 4/13/12 7:09 AM, Forbes J. Burkowski wrote: >>>>>> Hi: >>>>>> >>>>>> I have noticed that scripts can start with: >>>>>> >>>>>> import MMTK >>>>>> import MMTK.ForceFields >>>>>> from MMTK.ForceFields import Amber94ForceField >>>>>> >>>>>> We are doing some side chain packing studies that would benefit from the >>>>>> availablity of "easy" force field calculations. Currently, the algorithm >>>>>> works with useRotamers() to set two neighbouring rotamers and this is >>>>>> followed by a simple energy calculation to evaluate the interaction energy >>>>>> between the two rotamers. Right now, the energy calculation is only a bit >>>>>> more sophisticated than a steric collision detector. >>>>>> >>>>>> Question: Can we use some functions in the MMTK.ForceFields module to get >>>>>> an improved energy calculation? >>>>>> >>>>>> Any suggestions would be appreciated. >>>>>> >>>>>> Cheers, >>>>>> Forbes >>>>>> _______________________________________________ >>>>>> Chimera-users mailing list >>>>>> Chimera-users(a)cgl.ucsf.edu >>>>>> http://plato.cgl.ucsf.edu/mailman/listinfo/chimera-users >>>>> _______________________________________________ >>>>> Chimera-users mailing list >>>>> Chimera-users(a)cgl.ucsf.edu >>>>> http://plato.cgl.ucsf.edu/mailman/listinfo/chimera-users >>> _______________________________________________ >>> Chimera-users mailing list >>> Chimera-users(a)cgl.ucsf.edu >>> http://plato.cgl.ucsf.edu/mailman/listinfo/chimera-users >>> >>

5 7

Xlib: extension "NV-GLX" missing on display ":0".
by Thomas Evangelidis 07 Oct '12

07 Oct '12

Greetings, I am running Fedora 17 64-bit with bumblebee and akmod-nvidia on my laptop (the original nvidia drivers could not be installed). My GPU (not sure if this is helpful to know) is GeForce GT 650M and after doing that workaround with the open source drivers, in order to use the GPU I launch each program using "optirun" command (i.e. to launch pymol "optirun pymol", otherwise I get a black screen and the laptop automatically logs out). I have chimera production version 1.6.2 (build 36855) 2012-07-06 17:55:00 UTC, and whenever I run ./bin/chimera, with or without optirun, I see the small start up window "UCSF Chimera, an Extensible Molecular Modeling System" but after a couple of seconds chimera terminates with the following message: $ ./bin/chimera Xlib: extension "NV-GLX" missing on display ":0". Xlib: extension "NV-GLX" missing on display ":0". X Error of failed request: GLXBadCurrentWindow Major opcode of failed request: 153 (GLX) Minor opcode of failed request: 5 (X_GLXMakeCurrent) Serial number of failed request: 1376 Current serial number in output stream: 1376 Or with optirun: $ optirun --debug ./bin/chimera [18180.513653] [DEBUG]optirun version 3.0.1 starting... [18180.514638] [DEBUG]Active configuration: [18180.514642] [DEBUG] bumblebeed config file: /etc/bumblebee/bumblebee.conf [18180.514646] [DEBUG] X display: :8 [18180.514650] [DEBUG] LD_LIBRARY_PATH: /usr/lib64/nvidia:/usr/lib64/xorg/nvidia [18180.514653] [DEBUG] Socket path: /var/run/bumblebee.socket [18180.514656] [DEBUG] VGL Compression: proxy [18191.641124] [INFO]Response: Yes. X is active. [18191.641145] [INFO]Running application through vglrun. [18191.641242] [DEBUG]Process vglrun started, PID 3339. Xlib: extension "NV-GLX" missing on display ":0". Xlib: extension "NV-GLX" missing on display ":0". X Error of failed request: GLXBadCurrentWindow Major opcode of failed request: 153 (GLX) Minor opcode of failed request: 5 (X_GLXMakeCurrent) Serial number of failed request: 1376 Current serial number in output stream: 1376 [18199.687495] [DEBUG]SIGCHILD received, but wait failed with No child processes [18199.687528] [DEBUG]Socket closed. [18199.687540] [DEBUG]Killing all remaining processes. It is worth mentioning that the small start-up window disappears after saying "initializing OpenGL". Do you have any idea what I can do to fix it? Thanks in advance, Thomas

3 4

The style of Ribbon in alpha 1.7 version
by Cheng Wang 29 Sep '12

29 Sep '12

Dear Chimera Team, Hi. The ribbon style in 1.6 version is a little round for helix, while it is really flat in 1.7 version. I want to use v1.7 since several commands are really good for movie making eg. format option and transparency. However the ribbon style for helix is not as nice as it in 1.6. I am wondering how could I change the style of ribbon in 1.7 to be the same as in 1.6 since the ribbon style seams the same in the panel for both versions. Many thanks. Best, Cheng

2 1

Re: [chimera-dev] Match->Align command line option?
by Eric Pettersen 13 Sep '12

13 Sep '12

On Sep 13, 2012, at 11:55 AM, Chetanya Pandya wrote: > Hi Eric, > > Thanks for your detailed reply...it has been really useful! As instructed, I've installed today's daily build on my machine (running Fedora 15 32 bit). I've written a python script(see attached) which (hopefully) does what I want. > > Unfortunately, the script is unable to save the alignment as a file. It spits out an error which I'm unable to comprehend (see attached log file). > > Any help would be appreciated! Well, Multalign Viewer was designed a decade ago and has no non-GUI version. Therefore, the script cannot be run in nogui mode if it creates an MAV instance. So you have two options. One is simply to run your script in GUI mode. The Chimera window will come up and you will have to remain logged in until it finishes. The other is to get tomorrow's daily build, where I've modified makeAlignment so it is possible to just get the list of aligned Sequences instead of a MAV instance. That list can then be used to write the output file. The changes to your script would be in the makeAlignment call: seqs = makeAlignment(chains, makeMAV=False) and the way you call save: save(f, None, seqs, {}) (and remove the mav.Quit() call, obv.) > > Thanks, > --Chetanya > > P.S. - I would like to read more about the various packages and their functions. I can't seem to find a detailed writeup/manual. Can you direct me to a good source? This is probably our Achilles' heel -- there really isn't a good source. On the Programmer's Guide page there are links to the help() output for the main Chimera molecular data classes (which can also be viewed with the help() command in the IDLE tool). If you know a tool doesn't something similar to what you want, you can find out how it does it by looking in the source for the tool (all in <chimera installation>/share). If you know a command does what you want, use runCommand to run it, or look at the command's source (in share/Midas/__init__.py unless the command is implemented by a tool). Lastly, and probably most importantly, just asking here on the chimera-dev mailing list if you're stumped. And with our spotty programmer documentation, it's easy to get stumped! --Eric

1 0

Chimera-dev September 2012