| Chris Adams | |
|
2009-4-3 15:51
Even friendlier shell prompts for version control
I've extended the earlier VCS-friendly shell prompt to add support for Mercurial and you can now get my current .bash_profile from GitHub:
PS1='\[\033]0;\u@\h:\w\007\]\u@\h:\w$(__vcs_name) $ '
Even friendlier shell prompts for version control
Recently the topic of enhancing web pages came up at work. It's a lot easier than it used to be thanks to two trends: the rise of modern JavaScript libraries and public CDNs hosting those libraries. This makes a lot easier to enhance content which you can't easily alter (e.g. the forms used by various big companies with marginal web competency) or in situations where you're worried about compatibility with existing code (some squirrelly vertical apps in our case). Updated 2009-04-03: Moved the template and example scripts to Gist for ease of copying/maintenance: bookmarklet-template.js, enable-autocomplete.js and resize-textareas.js Updated 2008-10-14: there's a very similar jQuery-lovefest on Sam Ruby's weblog with plenty of useful tips. To illustrate just how little code this can require, here's an example which uses jQuery to install a function which sanitizes input (we have a legacy app chokes on smart-quotes and people paste text in from Word), copies the submit buttons from the bottom of the form to the top and adds a graphical datepicker for every date field on the page: jQuery":text,textarea"bind"change"sanitizer;
jQuery"form"bind"submit"
function
jQuery":text,textarea"eachsanitizer;
;
var submit_buttons = jQuery'input[type="submit"]';
submit_buttonsparentclonetrueprependTo
submit_buttonsparentsfilter'form'
;
jQuery'input[id*="DATE"]'datepicker;
That's the complete, ready-to-go, “even works with crotchety old Internet Explorer” guts of the code (the take-home lesson is that jQuery is awesome for busy developers). The downside is that this requires a little but of work: you need to have jQuery (and possibly dependencies like the UI plugin I used above) available and you need to jump through some hoops to load jQuery into an existing page efficiently and without conflicts. Didn't we used to pay for hosting?One drawback to all of this is that you need somewhere to host your external libraries since you can't fit the core jQuery into a URL, much less UI components or the less svelte libraries. This meant setting up a server, getting an SSL certificate if you need to work on HTTPS sites, etc. Not that much work but it's now a lot easier and quite noticeably faster because Google makes it trivial to get the popular AJAX libraries from their CDN. Developing with Bookmarklets
The deployment scenario for the major projects where I've used these techniques is a situation where you have some limited access to the page source: perhaps inserting a single If I was only working in Firefox I could use GreaseMonkey but I need to test in Safari and Internet Explorer, too. The portable solution is a simple bookmarklet. I use a simple template (bookmarklet-template.js) which loads jQuery from the Google CDN and, after everything is ready to go, runs either a simple function or the external script of my choosing. This makes it easy to prepare an injector bookmarklet which can be used to pull my code into the current page, after which I can run and debug it using Firebug. Useful ExamplesThis is also a useful technique for fixing other people's pages. Here are two bookmarklets and the commented source for tools which I use often:
I keep both of these in my Firefox & IE bookmark toolbar since they come in handy throughout the day and I've created more any time I find myself regularly needing to deal with a cranky legacy site. The process is simple: copy bookmarklet-template.js, add the code which does whatever fixups the target page needs, run the entire thing through JSLint and, finally paste it into Ted Mielczarek's very handy Bookmarklet Crunchinator. Good Code Injection PracticesUse Anonymous functionsWhat's the difference between this bit of code and the first example above? function
jQuery":text,textarea"bind"change"sanitizer;
jQuery"form"bind"submit"
function
jQuery":text,textarea"eachsanitizer;
;
var submit_buttons = jQuery'input[type="submit"]';
submit_buttonsparentclonetrueprependTo
submit_buttonsparentsfilter'form'
;
jQuery'input[id*="DATE"]'datepicker;
;
It looks almost identical but there's a key difference: this code is inside an anonymous function and that means that all of my variables are local to the function itself, which means that they won't be visible to other JavaScript on the page and I don't have to worry about conflicting variable or function names. Note that this is only true for variables declared using "var" - if you leave that out or do something like Reliably detecting when external code has loadedWhen jQuery has loaded, it's easy to say "Load this .js file and run this function when it's ready" - here's how the text-area resizer works: jQuerygetScriptdocumentlocationprotocol + "//ajax.googleapis.com/ajax/libs/jqueryui/1.5.2/jquery-ui.js"
function
jQuery"textarea"resizable;
;
Loading jQuery itself requires you to do this the hard way: generate a script tag on the fly, insert it into the document and listen for the load events to tell when it's safe to run code which depends on the library you're loading. This is easy for Safari, Firefox, etc. which support the standard W3C DOM addEventListener: simply run your code after the script tag fires a "load" event. Unfortunately, it's not that simple for Internet Explorer: in theory var s = documentcreateElement'script';
stype = "text/javascript";
ssetAttribute'src'documentlocationprotocol + '//ajax.googleapis.com/ajax/libs/jquery/1.2.6/jquery.min.js';
if saddEventListener
saddEventListener"load"loaderfalse;
else if "onreadystatechange" in s
if thisreadyState == 'complete' || thisreadyState == 'loaded'
loader;
;
else
// Chances are if your browser is this old jQuery won't even work but just in case:
windowsetTimeoutloader2500;
documentgetElementsByTagName'head'0appendChilds;
It's conceivable that a buggy browser could fire the same event twice in an unusual scenario and if you have any sort of user-driven or timer-based code, you'll want to prevent your payload from being run multiple times using a guard like this which allows the function to check whether it has executed before without using the more common approach of relying on a global variable. Besides cleanliness, this also makes it easy if you might inject multiple things onto a page and don't want to have to rely only on a global variable naming convention to prevent chaos: // Avoid executing this function twice:
if argumentscallee_executed return;
argumentscallee_executed = true;
Avoid HTTP/HTTPS conflictsIf you're injecting code into pages which may or may not use SSL, you have a problem: if you hard-code a URL in your code and the protocol doesn't match you'll either incur the extra overhead of starting an SSL session (which isn't a major problem) by using documentlocationprotocol + '//path.to.example.com/something.js'
2009-3-27 15:47
Tracking down mod_auth_cas segfaults
Just a quick note to boost Google rank: if you use the mod_auth_cas Apache module for CAS single-signon and have noticed sporadic Apache segfaults (typically a blank page which reloads correctly), mod_auth_cas 1.0.9 includes my patch which traps crashes caused by corrupted XML ticket files. Please let me know if this fixes your problem as we're still trying to isolate the underlying failure.
2009-3-21 14:18
Inching towards a Pythonic Keychain wrapper
I've started adding some more advanced ctypes wrappers for the OS X Keychain to PyMacAdmin. There's still a bunch of work to do but the upshot is that you can write code like this and expect it to work: try:
keychain =
item =
print "Removing %s" % item
except KeyError, exc:
print >>sys.stderr, exc.message
except RuntimeError, exc:
print >>sys.stderr, "Unable to delete keychain item: %s" % exc
and get output like this: chris@Enceladus:~/Development/pymacadmin [git master] $ ./bin/keychain-delete.py -a "acdha" Removing GenericPassword(service_name='', account_name='acdha', label='Audioscrobbler: acdha') There's a bunch of stuff going on behind the scenes now to make things easier than the sadly-unimproved state discussed at length by Wil Shipley back in 2006:
If you have any interest in wrapping native Mac APIs with Python please join the discussion over on the PyMacAdmin group - any sort of Python-OS X integration discussion is welcome.
2008-2-28 09:45
Using SystemConfiguration events within Python
Since this post was originally written, I've been working on the PyMacAdmin project with Nigel Kersten. The information below is still correct but the kicker-replacement script has gained the ability to handle filesystem events and workspace notifications and been renamed to crankd. In a perfect world software would gracefully network transitions. Unfortunately my users have encountered a fair number of things which don't always handle things like a laptop moving from ethernet to WiFi, a DHCP server taking awhile to respond, etc. While many programs have at least reached the point of eventually timing out and retrying it would be nice to automatically restart something as soon as the system network configuration changes. This is unfortunately system-specific and frequently required some hackish approach involving OS X has a nice way to query the current system configuration and receive event notifications when things change: the SystemConfiguration Framework (Technical Note TN1145: Living in a Dynamic TCP/IP Environment is also of interest). You can explore this using the scutil command-line tool - in the example below, I've looked at the list of available events and chosen to watch for power-state changes, receiving a notice when I unplugged the power cable from my laptop: chris@Enceladus:~ $ scutil > list subKey [0] = Plugin:IPConfiguration subKey [1] = Plugin:InterfaceNamer subKey [2] = Setup: subKey [3] = Setup:/ subKey [4] = Setup:/Network/Global/IPv4 subKey [5] = Setup:/Network/HostNames … subKey [21] = State:/IOKit/PowerManagement/CurrentSettings subKey [22] = State:/IOKit/PowerSources/InternalBattery-0 … > n.add State:/IOKit/PowerSources/InternalBattery-0 > n.watch > notification callback (store address = 0x1036c0). changed key [0] = State:/IOKit/PowerSources/InternalBattery-0 notification callback (store address = 0x1036c0). changed key [0] = State:/IOKit/PowerSources/InternalBattery-0 This is pretty cool stuff but I'd like to do something smarter than scripting a copy of scutil. I could write an Objective-C application but OS X 10.5 included the very handy PyObjC 2.0 which allows access to most of the native APIs directly from within Python. James Reynolds posted a message to the MacEnterprise mailing list which prompted me to stop procrastinating and actually write some code. A little poking around later and I have a Python script which is ready for me to add whatever custom actions I want to take when the network state changes - the version below is abbreviated so you'll want to download the full watch-network-config.py for your own use: from Cocoa import *
from SystemConfiguration import *
print "Global network configuration changed: ", changedKeys
# Kick a change-intolerant service in the head here
store =
Geoff Franks took the time to have the event handler use a dictionary so you can listen for multiple events and run a specific command for each one; I added a little syslog support and am releasing this version as a replacement for the widely-used Kicker which was removed in 10.5: Download kicker-replacement Fun lessons from the trenches: in versions of OS X prior to 10.5 there were several nasty bugs due to lookupd and DirectoryService not having real timeouts: we have some rigs which use DHCP on our public network and static IPs on a private experiment network. When the system booted the private interface didn't need to wait for a DHCP lease and thus came up slightly faster than the public interface — this should have been harmless except that DirectoryService immediately attempted to connect to our LDAP server which isn't reachable on the private network and network timeout values aren't actually used in any version prior to 10.5, causing network accounts and NFS mounts to be unavailable until someone manually killed DirectoryService!
2009-3-10 05:54
LDAP progress
One of the fixes for the LDAP problems I wrote about last year was just integrated into pam_ldap. This would have taken a very brief amount of time except that an updated patch vanished at some point between my mail server and the upstream bugzilla — ah, software!
2009-2-3 06:49
Friendlier shell prompts for version control systems
Like many developers, I'm using multiple version control systems these days - lots of Subversion, increasingly git and even some old RCS we haven't migrated away from yet. Here's handy little shell addition which includes info in the prompt, combining this git-specific tip with my older checks:
__vcs_name() {
if [ -d .svn ]; then
echo " [svn]";
elif [ -d RCS ]; then
echo " [RCS]";
else
echo "$(__git_ps1 ' [git %s]')"
fi
}
PS1='\[\033]0;\u@\h:\w\007\]\u@\h:\w$(__vcs_name) $ '
if [ -d ~/.bash_completion.d ]; then
for c in ~/.bash_completion.d/*; do
. "$c"
done
fi
Note that the last bit is needed to make the git part work - depending on your bash distribution you may not need to have the for loop to process The final result will look something like this: chris@Enceladus:~ $ cd Development/pymacadmin.googlecode/ chris@Enceladus:~/Development/pymacadmin.googlecode [svn] $ cd ../pymacadmin chris@Enceladus:~/Development/pymacadmin [git master] $ From the "We need a credible opposition party" file: Mitch McConnell wasn't laughed out of the GOP for claiming that the stimulus bill is flawed because it needs more cheap mortgages.
What is it about housing that causes this to be treated any more reasonably than, say, the idea that the US government should have offered cheap loans back in 2000 to protect the people who bought Pets.com at its peak? That's effectively the situation in many parts of the country and the housing market isn't going to settle on reasonable valuations any time soon if the federal government gets into the business of encouraging mortgages which no sane bank would otherwise offer. I can offer some recent experience: last week none of our local banks was anywhere near 4% even with excellent credit, a solid job, 50% down and a special employer-negotiated discount — and that's entirely what you would expect if you looked at the historical record. McConnell is shamelessly pandering to people who don't want to accept reality - and it seems increasingly unlikely that the remaining fiscal conservatives are going to be able to put adults in charge of GOP policy any time soon. It's also likely that the buckets of cash McConnell gets from real estate might have something to do with his zealous bubble-conservation efforts… |
|