Friday, January 17, 2014
Monday, June 6, 2011
Fereyel and Debbo Engal the Witch
Wednesday, January 26, 2011
OSX PDF Readers - Search Functionality - Acrobat vs. Skim vs. Preview
For starters, if you use only default Apple apps and expect the most seamless integration, then Preview is your best bet as it integrates nicely with Safari. However, since I use Chrome, I really don't care about that.
For this comparison, I won't be discussing the full feature-set offered by these PDF viewers but rather only those features that are of interest to me - specifically search accuracy and functionality.
My test doc will be "Brocade FastIron_07200_ConfigGuide.pdf", a technical document of 1,854 pages.
Test 1 (search for the string "link-aggregate"):
Preview:
A search bar and pane is oriented on the right side of the window.
There is a single means of searching - cmd+f
Preview begins searching in real-time as the search string is entered. There is no indication (e.g., status bar) of how long the search will take but there is a spinning wheel icon.
My search took 38 seconds and yielded hits for 9 Pages.
Preview doesn't say how many actual hits there are for the string in question but lists how many pages contain the string.
Adobe Acrobat Reader:
There is no search bar pane by default. There are (2) types of search.
1) Cmd+f launches a small blue pop-down search bar. Search values entered here are displayed one-at-a-time. Move forward using cmd+g and backwards using cmd+G
This is not that useful when searching a huge document because it offers no context of where the result is nested within the entire doc.
2) Cmd+F launches a separate advanced search window for an indexed search. The actual search is only run after the search string has been entered and "search" is clicked.
What's nice about this search is that a pop-up window will appear listing a progress status bar.
Preview is my least favorite. Search results, as displayed, are not as useful as Skim and Acrobat. Preview supports bookmarks.
Adobe is fast and accurate - a great research tool. Adobe does not support bookmarks although the Comment/Sticky Note features can be used as a pseudo-bookmark system within the local document.
Skim is accurate and with a fantastic interface. Skim supports bookmarks.
Currently I am using Adobe Acrobat Reader since I like having a large, separate window for searches. However, Skim is an excellent app that was my default PDF viewer before enhancements to Acrobat made it more competitive.
Friday, January 7, 2011
Creating Smart Folders in Thunderbird v.3.1.x

I completely forgot that I had a blog.
Thursday, January 7, 2010
CDMA Nexus One on Sprint PCS
I currently have an HTC Hero Android phone (when the hell is Android 2+ going to come out with HTC Sense already?!) but crave the Nexus One. I'm not alone here.
For those of us who are Sprint PCS subscribers because of their excellent pricing plans and top-notch data service and want the Nexus One I created a petition for folks to sign. Begging for it on message boards is one thing but a focused visible petition is another.
I urge potential or current Sprint PCS subscribers to sign it:
http://www.petitiononline.com/GN1oSPCS/petition.html
Thursday, September 10, 2009
Building Hadoop and Hypertable on Debian Lenny
Environment:
Systems: (2) SUN Virtualbox 3.0.6 Virtual Machines, both Debian Lenny x86
Hypervisor system: Debian Lenny AMD64
Networking: Bridged adapter (not NAT) to eth0
g++: 4.3.2
*Note: The fact that this test deployment is on virtual machines is irrelevant to the configuration of Hadoop or Hypertable. Since the (2) virtual machines are on a shared disk, high-performance IO is not expected. However, should the testbed prove promising, dedicated systems will be deployed and high-performance tuning of both Hadoop and Hypertable will be explored.
Background:
At NSLS-II we are toying with the idea of back-ending the next generation of the Channel Archiver with a distributed database atop a distributed filesystem. This for a myriad of reasons other than it being a "cool project". For example, combining Hypertable (a high-performance distributed data storage system) with the MapReduce functionality of Hadoop promises to offer performance, redundancy, reliability, and scalability.
Goals:
Build a (2) node Hadoop and Hypertable cluster. The (2) nodes are "systemA" (master) and "systemB" (slave).
(1) Prerequisites:
*Note: Building Hadoop and Hypertable in this document requires adding the unstable and (optionally) testing repositories to /etc/apt/sources.list.
(1) Make sure to specify that Lenny/stable is the default distribution:
Edit /etc/apt/apt.conf:
# apt.conf
APT::Default-Release "stable"; # Only "stable", "testing", "unstable" are acceptable release names; i.e., "lenny" is not accepted.
$ apt-get update
$ apt-get -y install g++ cmake libboost-dev liblog4cpp5-dev git-core cronolog libgoogle-perftools-dev libevent-dev zlib1g-dev libexpat1-dev libdb4.6++-dev libncurses-dev libreadline5-dev
(2) Install Hyperic-Sigar
$ wget http://internap.dl.sourceforge.net/sourceforge/sigar/hyperic-sigar-1.6.2.tar.gz$ tar -xzvf hyperic-sigar-1.6.2.tar.gz$ cp ~src/hyperic-sigar-1.6.2/sigar-bin/include/*.h /usr/local/include$ cp ~src/hyperic-sigar-1.6.2/sigar-bin/lib/libsigar-x86-linux.so /usr/local/lib/$ ldconfig
(3) Install Thrift:
$ apt-get -y install sun-java6-jdk ant autoconf automake libtool bison flex pkg-config php5 php5-cli ruby-dev libhttp-access2-ruby libbit-vector-perl liblog4j1.2-java erlang ruby libevent-1.4-2
$ update-java-alternatives --set java-6-sun
$ ln -f -s /bin/bash /bin/sh
$ wget www.hypertable.org/pub/thrift-r796538.tgz
* Note: Since I am behind a proxy I needed to set this variable:
$ export ANT_OPTS="-Dhttp.proxyHost=192.168.1.130 -Dhttp.proxyPort=3128"
$ ./bootstrap.sh
$ ./configure
$ make
(4) Build Hadoop:
(I) Get Hadoop:
Download the latest version of Hadoop. I untarred mine in /opt and made a symlink from hadoop-0.20.1 to hadoop:
The latest version can be found at this mirror:
http://ftp.wayne.edu/apache/hadoop/core/
At the time of writing this document, the latest Hadoop was version 0.20.1
$ wget http://ftp.wayne.edu/apache/hadoop/core/hadoop-0.20.1/hadoop-0.20.1.tar.gz
You can also retrieve the latest version via git, but the Hadoop directory tree is different than is what is referred to in this document.
$ git clone git://git.apache.org/hadoop-common.git
$ git clone git://git.apache.org/hadoop-hdfs.git
$ git clone git://git.apache.org/hadoop-mapreduce.git
$ ln -s /opt/hadoop-0.20.1 /opt/hadoop
Some source needs patching in order for Hypertable to cooperate with MapReduce. This is the list of files requiring patching:
/opt/hadoop/src/c++/utils/impl/StringUtils.cc
/opt/hadoop/src/c++/utils/impl/SerialUtils.cc
/opt/hadoop/src/c++/pipes/impl/HadoopPipes.cc
Here are the patches:
(i) SerialUtils.cc:
--- SerialUtils.cc (revision 765057)
+++ SerialUtils.cc (working copy)
@@ -18,7 +18,8 @@
#include "hadoop/SerialUtils.hh"
#include "hadoop/StringUtils.hh"
-#include
+#include
+#include
#include
#include
#include
(ii) StringUtils.cc:
--- StringUtils.cc (revision 765057)
+++ StringUtils.cc (working copy)
@@ -18,10 +18,11 @@
#include "hadoop/StringUtils.hh"
#include "hadoop/SerialUtils.hh"
-#include
+#include
#include
-#include
-#include
+#include
+#include
+#include
#include
using std::string;
@@ -31,7 +32,7 @@
string toString(int32_t x) {
char str[100];
- sprintf(str, "%d", x);
+ snprintf(str, 100, "%d", x);
return str;
}
@@ -96,7 +97,7 @@
const char* deliminators) {
string result(str);
- for(int i=result.length() -1; i >= 0; --i) {
+ for(int i = result.length() - 1; i >= 0; --i) {
char ch = result[i];
if (!isprint(ch) ||
ch == '\\' ||
@@ -116,7 +117,7 @@
break;
default:
char buff[4];
- sprintf(buff, "\\%02x", static_cast
+ snprintf(buff, 4, "\\%02x", static_cast
result.replace(i, 1, buff);
}
}
(iii) HadoopPipes.cc:
--- HadoopPipes.cc (revision 765057)
+++ HadoopPipes.cc (working copy)
@@ -26,9 +26,9 @@
#include
#include
#include
-#include
-#include
-#include
+#include
+#include
+#include
#include
#include
(II) Compile Hadoop:
$ cd /opt/hadoop/src/c++/pipes
$ sh configure
$ make && make install
$ cd /opt/hadoop/src/c++/utils
$ sh configure
$ make && make install
This will place Hadoop headers in:
/opt/hadoop/src/c++/install/include/hadoop
And Hadoop libraries in:
/opt/hadoop/src/c++/install/lib
Add the location of the Hadoop libraries to ld:
$ echo "/opt/hadoop/src/c++/install/lib" > /etc/ld.so.conf.d/hadoop.conf
$ ldconfig
Next we're ready to compile Hadoop.
$ cd /opt/hadoop
*Note: Again, because I am behind a proxy, I needed to set this environmental variable:
$ export ANT_OPTS="-Dhttp.proxyHost=192.168.1.130 -Dhttp.proxyPort=3128"
$ ant compile && ant jar
(III) Configure Hadoop:
(A) My Hadoop configuration files are kept in /opt/hadoop/conf
Relevant configuration files in this test are:
hadoop-env.sh # Environmental variables
core-site.xml # Default Hadoop filesystem
hdfs-site.xml # HDFS defaults for replication, name, and datanode services
mapred-site.xml # MapReduce defaults for trackers
slaves
master
*Note: All configuration files except for "slaves" and "master" will be the same on both cluster nodes.
(i) hadoop-env.sh:
By default Hadoop prefers ipv6. Since I am not using ipv6 this required a change:
HADOOP_OPTS=-Djava.net.preferIPv4Stack=true
other variables set in hadoop-env.sh:
export JAVA_HOME=/usr/lib/jvm/java-6-sun
export HADOOP_HOME=/opt/hadoop
export HADOOP_LOG_DIR=/var/log/hadoop
export HADOOP_SLAVES=${HADOOP_HOME}/conf/slaves
export HADOOP_PID_DIR=/var/hadoop/pids
This will require the creation of directories:
$ mkdir /var/log/hadoop
$ mkdir /var/hadoop/pids
(ii) core-site.xml (where "systemA" is the master node in the cluster):
scheme and authority determine the FileSystem implementation. The
uri's scheme determines the config property (fs.SCHEME.impl) naming
the FileSystem implementation class. The uri's authority is used to
determine the host, port, etc. for a filesystem.</description>
</property>
(iii) hdfs-site.xml:
*Note: dfs.replication specifies how many nodes are in the Hadoop cluster, in our case, (2).
*Note: This configuration requires the creation of a few directories, namely, "/dfsname", "/hadoop/data". If your test system has more than (1) system disk, it is advisable to separate the DataNode and NameNode directories so as to avoid contentious IO.
<property>
be specified when the file is created. The default is used if replication is not
specified in create time.</description>
<property>
namespace and transactions logs persistently.</description>
<property>
<name>dfs.data.dir</name>
<value>
<description>Comma separated list of paths on the local filesystem of
a DataNode where it should store its blocks</description>
</property>
(iv) mapred-site.xml:
*Note: This configuration requires the creation of the directory "/hadoop/mapred"
<name>mapred.job.tracker</name>
If "local", then jobs are run in-process as a single map and reduce task.*lt;/description>
</property>
system files e.g., /hadoop/mapred/system
(v) slaves:
*Note: both systems are slaves, so both are listed
*Note: this file is only configured on the master, "systemA"
systemA
systemB
(vi) Master (just the name of the master):
systemA
(B) SSH
Enable public-key authentication on all nodes within the Hadoop cluster. This will allow the Hadoop service to log-on to other nodes and start/stop services.
I am running Hadoop as the user "hadoop".
On both machines, create the Hadoop user:
$ groupadd hadoop
$ useradd -g hadoop -c "Hadoop User" -d /opt/hadoop -s /bin/bash hadoop
On the master server, systemA:
$ su - hadoop
$ ssh-keygen -t rsa -P ""
$ cp id_rsa.pub ~hadoop/.ssh/authorized_keys
Copy id_rsa.pub over the slave system and save it in the same place: ~hadoop/.ssh/authorized_keys
(C) Local name lookup
In /etc/hosts on both machines:
Enter all Hadoop node IP addresses and remove "127.0.0.1 localhost". Have "localhost" point to an assigned IP address
(IV) Initialize Hadoop:
*Note: Initialization is only necessary on the Master node.
*Note: For convenience-sake I've added Hadoop to my path:
$ export PATH=$PATH:/opt/hadoop/bin
$ hadoop namenode -format
$ start-dfs.sh
$ start-mapred.sh
Check to see what's running on both the master and slave:
systemA $ jps
4388 Jps
28444 NameNode
28795 JobTracker
2181 main
28696 SecondaryNameNode
28575 DataNode
28903 TaskTracker
systemB $ jps
13033 DataNode
13142 TaskTracker
1675 Jps
539 main
systemA $ netstat -ptlen
(V) Create a directory in the Hadoop namespace:
$ hadoop dfs -mkdir /hypertable
$ hadoop/bin/hadoop dfs -chmod 777 /hypertable
$ hadoop/bin/hadoop dfs -ls /
$ hadoop dfsadmin -report
(5) Hypertable installation:
(I) Get Hypertable:
$ apt-get -y install git sparsehash libbz2-dev doxygen graphviz
$ git config --global user.name "First Lastname"
$ git config --global user.email "something@something.com"
$ git clone git://scm.hypertable.org/pub/repos/hypertable.git
(II) Pre-build:
(A) Fixes:
The Hypertable source requires some patching so that the build cooperates with Debian's g++. The files that need to be patched are:
~src/hypertable/contrib/cc/MapReduce/TableReader.cc
~src/hypertable/contrib/cc/MapReduce/TableRangeMap.cc
(i) TableReader.cc:
--- a/TableReader.cc
+++ b/TableReader.cc
@@ -24,7 +24,7 @@ TableReader::TableReader(HadoopPipes::MapContext& context)
HadoopUtils::deserializeString(start_row, stream);
HadoopUtils::deserializeString(end_row, stream);
- scan_spec_builder.add_row_interval(start_row, true, end_row, true);
+ scan_spec_builder.add_row_interval(start_row.c_str(), true, end_row.c_str(), true);
if (allColumns == false) {
std::vector
@@ -32,7 +32,7 @@ TableReader::TableReader(HadoopPipes::MapContext& context)
split(columns, job->get("hypertable.table.columns"), is_any_of(", "));
BOOST_FOREACH(const std::string &c, columns) {
- scan_spec_builder.add_column(c);
+ scan_spec_builder.add_column(c.c_str());
}
}
m_scanner = m_table->create_scanner(scan_spec_builder.get());
(ii) TableRangeMap.cc:
--- a/TableRangeMap.cc
+++ b/TableRangeMap.cc
@@ -28,7 +28,7 @@ namespace Mapreduce
startrow = tmprow;
- meta_scan_builder.add_row_interval(startrow, true, startrow + "\xff\xff", true);
+ meta_scan_builder.add_row_interval(startrow.c_str(), true, (startrow + "\xff\xff").c_str(), true);
/* select columns */
meta_scan_builder.add_column("StartRow");
(B) Hypertable config
Edit ~src/hypertable/conf/hypertable.cfg and enter the information about the Hadoop Master:
# HDFS Broker
HdfsBroker.Port=38030
HdfsBroker.fs.default.name=hdfs://systemA:9000
HdfsBroker.Workers=20
(III) Build Hypertable:
Assuming that Hypertable has been unpacked in ~src then
$ mkdir ~src/build/hypertable
$ cd ~src/build/hypertable
*Note some important variables that need to be set in order for a successful compile on the Debian platform:
HADOOP_INCLUDE_PATH = /opt/hadoop/src/c++/install/include
HADOOP_LIB_PATH = /opt/hadoop/src/c++/install/lib
JAVA_INCLUDE_PATH = /usr/lib/jvm/java-6-sun/include
JAVA_INCLUDE_PATH2 = /usr/lib/jvm/java-6-openjdk/include
$ cmake -DBUILD_SHARED_LIBS=ON -DHADOOP_INCLUDE_PATH=/opt/hadoop/src/c++/install/include -DHADOOP_LIB_PATH=/opt/hadoop/src/c++/install/lib -DJAVA_INCLUDE_PATH=/usr/lib/jvm/java-6-sun/include -DJAVA_INCLUDE_PATH2=/usr/lib/jvm/java-6-openjdk/include ../../hypertable
$ make -j <number of cores>
$ make install
$ make doc
(IV) Had issues starting up Hypertable:
: error while loading shared libraries: libHyperThriftConfig.so: cannot open shared object file: No such file or directory
Temporary fix:
*Note: this is a stop-gap since this library is linked to files in the source. Don't delete the source. Need to fix this.
$ cp ~src/build/hypertable/src/cc/ThriftBroker/libHyperThriftConfig.so /opt/hypertable/0.9.2.6/lib/
(IV) Resolve issue with Hypertable connecting to Hadoop:
Replace the Hypertable-Hadoop jar with Hadoop's jar:
$ cp /opt/hypertable/0.9.2.6/lib/java/hadoop-0.20.0-core.jar /opt/hypertable/0.9.2.6/lib/java/hadoop-0.20.0-core.jar.hypertable
$ cp /opt/hadoop-0.20.1/hadoop-0.20.1-core.jar /opt/hypertable/0.9.2.6/lib/java/hadoop-0.20.0-core.jar
(V) Initialize Hypertable:
*Note: Added Hypertable to path:
$ export PATH=$PATH:/opt/hypertable/0.9.2.6/bin
$ start-all-servers.sh hadoop
(V) Hypertable Scripts (reference):
start-dfsbroker.sh (local|hadoop|kfs) [
start-hyperspace.sh [
start-master.sh [
start-rangeserver.sh [
start-dfsbroker.sh hadoop
clean-database.sh
And a wrapper script to start all services:
start-all-servers.sh (local|hadoop|kfs) [
Enjoy!
Friday, August 21, 2009
Debian dbus - ldap error messages on boot
udevd: nss_ldap failed to bind to LDAP server .....
Quick search displayed many bug reports, obviously not fixed since I'm endured this on a freshly upgraded Debian Lenny system. Some comments I read were silly, like folks having the system boot with a nsswitch.conf using only "files" for passwd, group, and shadow, then switching to "ldap files" or "compat" after boot.
Fix for me was (2) steps:
1. Leave /etc/nsswitch.conf the way it was -- "compat ldap" only and add the problematic user to the LDAP server. And the problematic user is [drumroll]
2. Edit /etc/libnss_ldap and add:
bind_policy soft
Server boots, fixed, no error messages, done, back to work...
Thursday, August 20, 2009
OpenNMS and Apache2 on Debian Lenny
What's the motivation? Jetty as built via OpenNMS does not have a configurable cipher suite or at least an obvious and/or intuitive method that wouldn't necessitate web crawling. Weak ciphers create noise on a Nessus scan listing it as a medium-level vulnerability. I found (2) how-tos on the OpenNMS wiki and both of them entailed using Jetty with AJP support. I wanted something simpler.
1. Edit /etc/opennms/opennms.properties and uncomment this line:
opennms.web.base-url = https://%x%c/
Restart OpenNMS
2. Install mod_proxy for Apache2 and add module:
$ a2enmod proxy
Beware that the default Debian proxy configuration disallows all proxy access. My installation required me to loosen it up a bit.
Edit "/etc/apache2/mods-available/proxy.conf", get rid of "Deny from all" and add:
Allow from 127.0.0.1/8 192.168.90.0/24
3. Add the virtual host entry for OpenNMS on Apache. Edit "/etc/apache2/sites-available/default-ssl" and add:
ProxyPass http://127.0.0.1:8980/opennms
ProxyPassReverse http://127.0.0.1:8980/opennms
Done. Everything works fine. Nessus is happy. Deployment secure.
Tuesday, January 27, 2009
Cray pas haunted house
My daughter likes haunted houses...
Friday, January 23, 2009
Cray pas -- first go
Thursday, January 22, 2009
Mind mapping software: XMind vs. FreeMind vs. MindManager vs. Inspiration
Enter mind mapping. I've spent a considerable amount of time this past week evaluating various mind mapping software on OS X. The candidates were MindJet MindManager 7, Inspiration, FreeMind, and XMind
Here's a summary of my impressions:
Inspiration:
- Old MacOS9 look and feel
- Costs $$$$ -- but why should I pay that for a something that feels so outdated?
- Crashed twice and felt somewhat unwieldy for very large corporate or engineering projects
- Very very nice outline mode handy for cut and paste right into a doc or email.
- Might consider the Kidspiration for the youngins
- $$$ but the newer MM8 is only available on Windows
- Frequently crashed (due to evaluation? Doubt it)
- Overview mode was annoying with no automatic way of expanding every node in the tree
- Nice interface and keyboard shortcuts
- Good documentation
- Supports floating nodes
- Worked quite well -- felt productive from the start.

- OpenSource. This is the product I wanted to like the most being a fan of the opensource community.
- Full export
- Cloud functionality mimics XMind boundaries.
- Text mode is somewhat clumsy -- how does one delete the text icon when there is no longer any text without deleting the node itself?? This is precisely the sort of information I don't want to waste time digging around for.
- Documented key-mappings for Mac didn't always match reality
- Overview mode?
- Annoying options menu -- especially choosing default colors
- No floating nodes and difficult to place nodes where you want them (they're always snapping back to the way FreeMind wants it)
- Somewhat primitive look and feel
- I took some time before I felt truly productive with this product
XMind:

- Some components OpenSource
- Extremely polished, friendly interface
- Good documentation
- Floating nodes
- Intuitive -- felt productive almost at once.
- Easy to both add and delete notes using function+F4
- Compact legend of key-bindings instantly accessible via ↑⌘L
- Optional tri-pane window featuring outline view and properties
- Cool Boundary and Summary functions
- Nice auto-styling like multi-branch coloring and line tapering
- Flexible node styling such as rounded, rectangle, callout, fishhead
- Useful templates
- Can't export to PDF in the free version
Ranking: 1) XMind, 2) FreeMind, 3) MindManager, 4) Inspiration.
XMind just wins hands-down in $$$, ease of use, form, and function. I would even consider purchasing the yearly subscription for some advanced features (Gantt charting) @ $49 a bargain.
Freemind is nice, too, but not as polished, full-featured, or easy to use as XMind. As mentioned before, I like opensource community projects, but in the end I need to get work done.
Shortly after XMind was made available at no cost, one of the FreeMind developers initiated a thread on the FreeMind mailing list asking whether or not it was worthwhile to continue that project (see here). Obviously the answer should be yes -- why crumple in the face of competition? Reading through the thread, however, I noticed a lot of commentors stated that while XMind is good, it's also slow whereas Freemind is lean and fast and, as such, Freemind is more suitable for quick off-the-cuff mapping. While it is true that Freemind is a bit spryer I feel this is negligable -- at least on a modern desktop.
Wednesday, December 17, 2008
Keeping my iTunes Library on an external hard drive across systems
Real simple: I have both an Apple desktop and laptop with limited disk space and want all my iTunes media to reside on an external HD that I can switch between systems.
This is fairly straight-forward. In "Advanced Preferences" I changed the "iTunes Music folder location" to my external drive (in my case: WD Passport/iTunes:). This worked well for me until today. Now to backtrack a little, when I first set-up this schema I even symlinked the ~/User/Music/iTunes directory to my external disk with the notion that I'd even want " iTunes Music Library.xml" (the dictionary file that maps every file in iTunes) on the external drive. Ultimately this was stupid because if the external drive was not connected I couldn't fire up iTunes to listen to, say, the radio, without the application wanting to create an new library (equivalent to launching iTunes while pressing alt).
But that was then and this is now. I'm not sure why my iTunes directory got screwed today but it did.
What happened was I accidentally "reset" the "iTunes Music folder location" which defaulted to my local hard drive. When I tried to add the external hard drive location, the iTunes directory was greyed out (grayed out). Greyed out meaning I couldn't add it. Then I attempted "Add to Library" (command+o) and the external iTunes directory was also greyed out. WTF??
At first I thought there was some defaults com.apple.iTunes RootDirectory entry I could fool with like I did when I wanted to default my iPhoto Library to the external hdd some time ago. But no go (another case of an OS X inconsistency).
It wasn't until I thought about doing something inane with permissions that I noticed that the iTunes directory on the external disk was an iPhoto-esque package content directory. "Get Info" on iTunes even listed "open with iPhoto". Hmmm. I stupidly changed it to "open with iTunes" but that was low-brow desperation.
Opening a shell and doing a "ls -lad" on iTunes showed:
drwxr-xr-x@ 20 rpetkus staff 680 Dec 17 19:40 iTunes/
What is "@"? "man ls" informs me that @ = extended attributes which I can list with "-@"
$ ls -lad@ iTunes/
drwxr-xr-x@ 20 rpetkus staff 680 Dec 17 19:40 iTunes/
com.apple.FinderInfo 32
What is com.apple.FinderInfo? Turns out this is a Uniform Type Identifier (UTI) which ascribes a lot more meaningful type data to a file than a mere file extension (.jpeg) or MIME type. I found this older link which was a informative read about UTIs on OS X.
After my reading assignment I surmised that I want to get rid of this extended attribute using the "xattr" command which doesn't have a man page but "xattr -help" is pretty self-explanatory.
Make iTunes a normal folder again:
$ xattr -d com.apple.FinderInfo iTunes/
Viola! iTunes on my external hard drive is no longer greyed-out, I can set it as my Music Folder location and "Add to Library". Resolution.
As a side note, if you're doing the same thing with your external hdd, make sure under "Advanced Preferences" that you select "Copy files to iTunes Music folder when adding to library". This way, if you add more media to iTunes on one system with the external drive, it indeed gets copied there for consumption on the second system.
Monday, December 1, 2008
Solaris 10, Kerberos, and OpenLDAP
Monday, November 17, 2008
The Great Farce Part I
Then, one day, without warning, word spread that OD was to retire from his storied post. Since OD rarely communicated anything to the larger group, the advertisement for the ND was discovered in a vocationally relevant circular. Change was in the wind and would arrive in the Spring.
About a month or so before the arrival, there were a series of secret meetings amongst the mid and upper-level managers. It was crucial to strategize earlier rather than later. Would the pecking order be preserved, could new territory be up for grab? Old allegiences were strengthened and enemies were kept close. There would be alignment with the new power at all costs. Every ounce of data obtained about ND was parsed for clues and suggestions from the most heralded dissertation to the meagerest plea for help on a mailing list. And yours truly? I was cynical yet optimistic. I was hoping for my chance; a meritocracy.
Enter Spring. It was buzzing that a wholly new organizational chart had been devised. There was an endless queue of covert meetings between ND and the mid/upper level managers. Decisions were being made and, as far as I knew, the common folk that produced real things, such as myself, were never consulted. It was leaked that, at the behest of ND, a quasi-famous Industrial Psychologist (IP) had been hired to analyze the staff, make assessments, and present reportage and council to ND. It was at this point that I become uneasy and warn't too shy about it, neither.
IP had authored some books and wrote vignettes for public radio. IP was disarming enough, as I suspected would be the case. Each staff member was allotted one hour of couch time. Some folks strode in there thinking this was their big opportunity to be an instrument of change, some were paranoid and promised to present to IP an inpenetrable shell, and one particular clown read up on industrial psychology ahead of time, picked up a bit of argot, and sought to turn the tables. I wasn't interested in any of that. I resolved to be forthright and helpful but I wasn't in the mind to put my cards on the table, so to speak. I was more interested in listening to the type of language employed by IP and keen to identify the triggers that implored me to lower my guard and spill forth -- knowledge of those triggers and techniques could be useful.
Upon completion of all the interviews, IP anonymized and categorized the data into a series of talking points and presented it to the staff during a lively 2 hour group meeting. Common issues and concerns were bulletted and reviewed. I list some specimens that will become relevant later on here:
1. People's roles and responsibilties are either ill-defined and nebulous so as to mean nothing or they are too specific and thus constrictive.
2. People want a more transparent organization, one where decisions and logic are communicated and where input is encouraged and well-regarded.
3. People want the opportunity to become more involved, redefine their roles, and grow professionally.
To be continued...
Friday, November 14, 2008
The Mens Room
- Talking on cell phones, especially while in the stall
- People afraid to urinate at the urinal and use the toilet instead - worse when they leave the stall door open
- People that, given an entire row of empty urinals, chose the one next to yours
- People that can't urinate unless they keep flushing the urinal
- People that make a show of excessive shaking, tugging, and groaning upon completion
- People who drop pants and even worse, underwear, to the floor at the urinal
- People that stand and have a lengthy conversation after the business is finished
- People who leave the stall and don't wash their hands
- People who leave the door knob wet when they leave
CHEP 2009 - Prague
I've always had a romance for Prague -- I imagine it to be a labrynthine, stoney grey web of spires and mystery in the spirit of Kafka. In the 1991 Soderberg movie, Kafka, Prague was an intensely dark and murderous place. The movie rehashed many of Kafka's own themes: isolation, transformation, paranoia, and institutional oppression. I especially liked when the movie moves from black and white to full color once Kafka (Jeremy Irons) enters the Castle -- with all the appropriate elbows and winks to Dorothy in Oz.
Then I recall reading something about Einstein, Kafka, and Freud hanging out in Prague but I don't know if that's real or just a myth...
Anyway, here are the abstracts -- it took a minimal of effort to write them up -- if they get accepted then I'll craft something good.
Title: dCache Storage Cluster at BNL
Abstract content
Over the last (2) years, the USATLAS Computing Facility at BNL has managed a highly performant, reliable, and cost effective dCache storage cluster using SunFire x4500/4540 (Thumper/Thor) storage servers. The design of a discreet storage cluster signaled a departure from a model where storage resides locally on a disk-heavy compute farm. The consequent alteration of data flow mandated a dramatic re-construction of the network fabric.
This work will cover all components of our dCache storage cluster (from door to pool) including OS/ZFS file-system configuration, 10GE network tuning, monitoring, and environmentals. Performance metrics will be surveyed within the context of our Solaris 10 production system as well as those rendered during evaluations of OpenSolaris and Linux. Failure modes, bottlenecks, and deficiencies will be examined.
Lastly, we discuss competing architectures under evaluation, scaling limits in our current model, and future technologies that warrant close surveillance.
Presentation type (oral | poster)
Oral
Primary Authors:
PETKUS, Robert (Brookhaven National Laboratory)
Co-authors:
KARASAWA, Mizuki (Brookhaven National Laboratory)
MCCARTHY, John (Brookhaven National Laboratory)
SMITH, Jason (Brookhaven National Laboratory)
Abstract presenters:
PETKUS, Robert
Track classification:
Hardware and Computing Fabrics
Title: Building a Storage Cluster with Gluster
Abstract content
Gluster, a free cluster file-system scalable to several peta-bytes, is under evaluation at the RHIC/USATLAS Computing Facility. Several production SunFire x4500 (Thumper) NFS servers were dual-purposed as storage bricks and aggregated into a single parallel file-system using TCP/IP as an interconnect. Armed with a paucity of new hardware, the objective was to simultaneously allow traditional NFS client access to discreet systems as well as access to the GlusterFS global namespace without impacting production.
Gluster is elegantly designed and carries an advanced feature set including, but not limited to, automated replication across servers, server striping, fast db backend, and I/O scheduling. GlusterFS exists as a layer above existing file-systems, does not have a single-point-of-failure, supports RDMA, distributes metadata, and is entirely implemented in user space via FUSE.
We will provide a background of Gluster along with its architectural underpinnings, followed by a description of our test-bed, environmentals, and performance characteristics.
Presentation type (oral | poster)
Oral
Primary Authors:
PETKUS, Robert (Brookhaven National Laboratory)
Co-authors:
SMITH, Jason (Brookhaven National Laboratory)
Abstract presenters:
PETKUS, Robert
Track classification:
Hardware and Computing Fabrics
Title: Log Mining with Splunk
Abstract content
Robust, centralized system and application logging services are vital to all computing organizations, regardless of size. For the past year, the RHIC/USATLAS Computing Facility (RACF) has dramatically augmented the utility of logging services with Splunk. Splunk is a powerful application that functions as a log search engine, providing fast, real-time access to data from servers, applications, and network devices. Splunk at the RACF is configured to parse system and application log files, script output, snmp traps, alerts, and has been integrated into our Nagios monitoring infrastructure.
This work will detail our central log infrastructure vis-`a-vis Splunk, examine lightweight agents and example configurations, consider security, and demonstrate functionality. Distributed Splunk deployments or clusters between institutions will be discussed.
Presentation type (oral | poster)
Oral
Primary Authors:
PETKUS, Robert (Brookhaven National Laboratory)
Co-authors:
SMITH, Jason (Brookhaven National Laboratory)
RIND, Ofer (Brookhaven National Laboratory)
Abstract presenters:
PETKUS, Robert
Track classification:
Software Components, Tools and Databases
Thursday, November 13, 2008
Social Bookmarking
It's a natural progression for yours truly. At first, many years ago, I'd set my home page to a web portal like Excite! or Yahoo, which I eventually customized to include the news and stock tallies, etc., and revisit throughout the day. Later on I made a ritual out of visiting a selection of bookmarked sites that offered the perspectives I sought during the day: NYTimes, Register, Onion, Slashdot. Then RSS and ATOM made this process simpler and more attractive since I could have information pushed rather than pulled.
But the problem was always the same -- unless I was willing to spend an inordinate amount of time spelunking the web, I would never be exposed to new and innovative sources of interest. This began to change when I began to utilize Del.icio.us and Google Reader. The great thing about Del.icio.us was that once I began to populate my account with all the random bookmarks I deemed valuable I was immediately exposed to others who were interested in the same thing. I could then browse the other, similarly categorized bookmarks these far-flung siblings had chosen to cherish. In effect, I was able to benefit from the research, googling and web-mining of others. I discovered virtual soul-mates who were prolifically bookmarking previously unknown and valuable web pages. I would parasitically attach myself to them via anonymous RSS subscription. For all I know they were attaching themselves to greater source. Perhaps every user of Delicious is merely a decomposer fed from a single autotroph.
Google Reader, a web-based aggregator, is a different animal. A user essentially populates their reader, an empty canvas, with a selection RSS and/or ATOM feeds (the selection is Google-vast), and reads articles through the interface. The application tracks and tallies what you have and haven't read, what you've labeled worthwhile, and begins to suggest new sources of information. The more you use the system, the more intelligent the suggestions. Again, this has had an impact on my daily consumption of information and I appreciate the exposure I receive to different sources of data.
There is something sinister about these tools. In effect, I am allowing myself to be observed and studied. I'm confident dissertations will be penned exploring the reduction of human psychology via web trend analysis. I imagine a superior advertising product will be engineered based on the information obtained when folks like me use a system such as this on a regular basis. But this is another matter.
Today, my attention has been drawn to social bookmarking sites such as Digg and StumbleUpon. I've created accounts with both services and intend on giving them a full evaluation. Will these tools expose me to the information I seek with minimal work? Will I be able to reclaim more hours of the day and spend them away from a monitor? Will I be fed information that I don't necessarily want to read but am meant to read? Only time will tell.
The Farmingdale Library web site isn't entirely lame but alisweb.org is
The Farmingdale Library does allow patron account access. I can view material currently checked out, renew online, request inter-library loan (with email notification), and even opt into a system wherein all my activity is tracked for personal analysis (I opted). They use a system utilized by all libraries in Nassau County called the Automated Library Information System Web Catalog, or Alisweb.
This is what it looks like -- as you can see I'm overdue on a number of items.

Now I'm a severe library buff and so are my kids. There was a time many years ago when I would spend many hours and dollars in Borders-n-Barnes&Nobles. Strand was a mecca and old George Lenz in Huntington had all the literary gems (Faulkner, Proust, Joyce, Nabokov) in the ever-so-hip 8x5.2 sizing for $8-10. As a kid my room was stuffed wall to wall with bookcases, books piled 2-3 levels deep, falling off the shelves, and atop every piece of furniture.
Then everything changed when I had kids. Even before progeny one breathed her own air I began building a mini child library. Until I realized that the majority of my selections were flops: Daddy, I don't like this book. I simply cannot predict what my kids are going to like. The library changed this -- I've donated a significant portion of my collection and simply see no reason why I would ever need to purchase a book again. I'm really referring to recreational reading books here, not reference or professional volumes.
The public library evokes all the sentiment it held when I was in elementary school. Now I recall with embarrassment how I had all those $20 Stephen King hardcovers during junior and high school -- did I ever ever read one of those books more than once?
But I'm supposed to be speaking about alisweb. Cool idea -- horrible implementation. In order to access your account one needs to enter 1) username, 2) 14-digit library card barcode, and 3) 4-digit pin. The site doesn't support encryption which is real annoying but I figure it's not like I'm entering my bank account password. At worst, someone can request a bunch of books on my behalf and cause some annoyance for me. Otherwise, I'm not taking out how-to books on nail pipe-bomb or pvc silencer manufacturing so I go ahead, enter the information, close my eyes and inject my clear-text library genome straight into cyberspace.
Since it's not SSL, the Safari browser can't store the password and Firefox only stores the 4-digit pin -- I can remember the 4-digit pin, it's the 14-digit number that's the problem! Now get this: Every time you navigate away from "personal settings" and back again, you have to re-enter everything again -- including the 14-digit number! What a piece of garbage. I want to contact Innovative Interfaces, Inc. and tell them how uninnovative their interface is.
Here is my open letter to Innovatice Interfaces, Inc.:
Please consider SSL and credential management.





