OpenFiler challenges (and solutions)

I’ve been having trouble getting samba shares to work.

This may help:

https://lists.openfiler.com/viewtopic.php?id=6031

Had trouble connecting a LDAP explorer/browser to the Openfiler LDAP server.
Figured it out.

IP: Openfiler’s IP
Port: 389
user: cn=Manager,dc=openfiler,dc=nas
password: ‘password in openfiler’s LDAP screen’
base dn: dc=openfiler,dc=nas

To Change home FTP folder: Login in with any LDAP explorer/browser (I use JXPlorer) and navigate to the user. In the user view, change the attribure homeDirectory to whatever folder you want. (currently set to /mnt/storage_vg/data/incoming/)

Xenserver reading

http://www.xendesktopmaster.com/how-to-add-an-additional-local-disk-to-your-xenserver-5-5-host/

http://www.ruslansivak.com/2010/3/29/XenServer-55–Converting-Local-Storage-to-ext3-and-thereby-enabling-sparse-provisioning

http://www.schirmacher.de/display/INFO/How+to+add+additional+disks+to+XenServer+host

Adding removable drives

http://kiekeboe100.hoefman.be/blog/2009/06/attaching-disk-to-xenserver-guest/

http://everyrandom.com/blog/?p=89

UnRAID hidden files problem

For the longest time (ever since I had set up unRaid) I had an issue with the files saved on the unRaid system showing up as hidden files when viewed in a microsoft windows environment.

Never really liked that. My solution had been to enable viewing of hidden and system files, but it was a workaround. Never really knew why this was happening, until now.

I came across this post on the Unraid Forums. Just need to add a couple of lines to discourage samba to make the files hidden and system files.

Xenserver: moving data to remote file server

I am considering moving the Xenserver machines to a network location, removing them from the box in which the hypervisor is residing.

I have a gigabit network which theoretically can transport just over 100MB/s worth of data (about 125MB/s I think is the calculation) but I expect less then that in the real world.

A 100Mb network can do 12.5MB/s, but realistically, only about 9MB/s is capable after all the networking overhead is introduced, so assuming 90MB/s for a gigabit connection may not be unreasonable.

HD normally put out 40-60MB/s, so a gigabit network should not be a bottleneck (assuming only one connection).

Going to run some tests to see what throughput my LAN can sustain.

Running bonnie++ on /mnt/tower/disk1 I get

Version 1.03d       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
apps-server05 2072M 22582  11 23699   1 15228   0 53534  35 62733   1 165.6   0
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16   832   2  1852   1  1079   1   812   1  2153   0   840   1

Locally on the workstation running Bonnie++ on the SSD drive with a 8gig file (4gigs ram in machine) I get:

Version 1.03d       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
workstation01 7416M 63910  62 49520  20 24627  11 96748  92 233131  38  2300   9
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++

On the same workstation, using a 7200rpm 160 gig drive, I get:

To be done

I did some file copies with SCP (since it reports the transfer rate).
Between machines on the xen hypervisor with a local file I am getting about 75MB/s
Between same machines, with a file stored on the UnRAID server I am getting about 30MB/s in read speed. This is obviously limited by both the UnRAID machine or the network connection.

Did another SCP between my workstation machine and a virtual machine and I topped out at 9.9MB/s
Will have to investigate this further since I’m obviously only getting 100Mbit speeds, when I have a 1Gb connection? Maybe not…

AS assist v3 project update: The light source

In the search for a focus solution, I am going to abandon the laser pointer light source in favor of an AF assist light from a proper flash unit.

Doing some research here and looked at a whole bunch of flashes, and some of the flash manuals have a range in which the AF illuminator/assist light is effective. The listed number is the max range listed in the official user manual (in meters and feet). Continue reading

Copy recursively files of one type

I needed to copy a bunch of JPGs from one folder structure to a mirror structure, but didn’t want to copy all the RAW files. Came across two examples. I tried the second (mainly because I understand it), and it worked nicely.

Example 1

Code:
#!/bin/bash
cd /home/images
find . -depth -type f -name '*.jpg' | cpio --pass-through \
 --preserve-modification-time \
 --make-directories --verbose /home/new_dir

Example 2

Code:
#!/bin/bash
cd /home/images
find . -type d -name '*' -exec mkdir -p /home/new_dir/{} \;
find . -type f -name '*.jpg' -exec cp {} /home/new_dir/{} \;

 

AF Assist tool v3.0

To layout the expectations for the next AF assist tool. The last AF assist tool v2.0 had it’s weaknesses, and I will try to address some/all of those with the next tool.

Some of the changes from v2.0 to v3.0:
– Explore the use of other AF lights. Try lights with grids from existing flashes, near IR leds, (others) to achieve a pattern/light that is both not distracting to anyone and not very visible yet enables a DSLR to quickly focus.
– Follow and recreate some of the efforts out there to reverse engineer the ETTL protocol and use it to keep the tool on ONLY while the camera is focusing. The two sources for the reversed-engineered protocol are on Kzar.net and Bill Grundmann’s Blog. I’ve wanted a project for an Arduino, and this may be the one.

 

Some more efforts to create an AF assist light:

http://www.flickr.com/groups/strobist/discuss/72157625363074208/
asa

http://www.youtube.com/watch?v=IhiHNzx0tMA&feature=related