155 Commits

Author SHA1 Message Date
Vijay Bellur
be4dee16c1 Changes for Dynamic Volume Management
Signed-off-by: Amar Tumballi <amar@gluster.com>
Signed-off-by: Vijay Bellur <vijay@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 1196 ()
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=1196
2010-07-22 23:10:38 -07:00
Amar Tumballi
00b1846823 'gluster volume defrag' related bug fixes
Signed-off-by: Amar Tumballi <amar@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 1073 ('gluster defrag <VOLNAME>' fails in mainline)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=1073
2010-07-20 09:46:08 -07:00
Amar Tumballi
ddd614192d volgen now takes 'num-replica' and 'num-stripe' options
Signed-off-by: Amar Tumballi <amar@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 1155 (currently volgen doesn't take num-replica and num-stripe options)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=1155
2010-07-19 05:11:13 -07:00
Amar Tumballi
654a720eed proper way to do defrag of a mountpoint
Usage: "glusterfs-defrag <MOUNTPOINT>"

there are new features added to distribute with this patch:

* bash# getfattr -n trusted.distribute.linkinfo <file>
  Gives output in the format "<hostname>:<directory>", if there is a
  linkfile present, where hostname is server, directory is backend
  directory where the actual linkfile is present.

* bash# getfattr -n trusted.glusterfs.pathinfo <path>
  Gives layout information if directory, and info about actual
  location of file in backend servers, in the form of
  'hostname:directory'. (TODO: should extend it to all xlators)

* bash# getfattr -n trusted.distribute.fix.layout <path>
  scales out the directory layout in distribute, so when new
  servers are added, layouts are fixed to include them.

* removed 'scale-n-defrag.sh' as its no more required.

* changed 'defrag.sh' to have a feature to specify target bricks,
  so defrag happens to only those nodes. moved the file to
  'glusterfs-defrag', which now gets installed to '${prefix}/bin'

* storage/posix:
  takes new option 'hostname' so it can resolve to same hostname
  given during 'gluster volume create'.
  with 'trusted.glusterfs.pathinfo' posix returns the value in
  'hostname:real_path' format.

Signed-off-by: Amar Tumballi <amar@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 1073 ('gluster defrag <VOLNAME>' fails in mainline)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=1073
2010-07-14 14:44:26 -07:00
Amar Tumballi
915adb9c12 gluster-CLI-and-mgmt-glusterd-added-to-codebase
Signed-off-by: Vijay Bellur <vijay@gluster.com>
Signed-off-by: Amar Tumballi <amar@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 971 (dynamic volume management)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=971
2010-07-08 23:28:08 -07:00
Raghavendra Bhat
dbcb981892 Changes to volgen such that it does not error out in python2.4
Signed-off-by: Raghavendra Bhat <raghavendrabhat@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 988 (volgen in master generates error)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=988
2010-06-10 05:24:36 -07:00
Shehjar Tikoo
5b0d583cc4 extras/gnfs-lognalyzer: Delete class instance to release mem early
Signed-off-by: Shehjar Tikoo <shehjart@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 913 (NFS-specific log analyzer tool)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=913
2010-06-01 00:24:02 -07:00
Csaba Henk
5e03484d1d OS X: make location of launchd service configurable
Signed-off-by: Csaba Henk <csaba@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 361 (GlusterFS 3.0 should work on Mac OS/X)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=361
2010-05-31 05:39:22 -07:00
Vikas Gorur
e3ea64186a glusterfs-profiler: Add text mode support.
glusterfs-profiler works in text mode by default now. This allows it to run on systems which don't have matplotlib installed.

Modes can be selected using:

  -m graph        - Graphical mode
  -m text         - Text mode (default)

Signed-off-by: Vikas Gorur <vikas@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 268 (Add timing instrumentation code)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=268
2010-05-11 10:09:52 -07:00
Shehjar Tikoo
7c9df49689 extras: Add NFS-specific log analyzer tool
Most of the time, a NFS request and the reply are separated by hundreds
of lines of other debugging output most of which is not always relevant
for NFS debugging. This script synthesizes the full glusterfs log into
the parts relevant for NFS while bringing together the NFS requests with
there replies on one line.

Min log-level required for this script to be useful is DEBUG. Only
works for NFS translator.

Signed-off-by: Shehjar Tikoo <shehjart@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 913 (NFS-specific log analyzer tool)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=913
2010-05-10 02:18:08 -07:00
Harshavardhana
bf18a37a1b extras/volgen: Volgen patchset
-- Supports NFS Translator.
-- Consolidated common API's into Common.py.
-- Removed unused CreateBooster.py.
-- Added code for "--add-server" for dynamic volumes.
   Currently its commented out we will use it when needed.
-- No more options hiding in background anymore. All options
   specified for each translator are commented and exposed.
   Only necessary values are  enabled. This is done due to
   necessary cleanup of unwanted options by exposing them.
   PENDING: "replicate" translator
-- Quota is disabled for native NFS on client side.
   Only server side quota can be used as of now.
-- Additional code cleanup.

Signed-off-by: Harshavardhana <harsha@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 822 (Volgen changes supporting NFS)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=822
2010-04-22 07:05:07 -07:00
Vikas Gorur
9c2bfa8a44 extras/profiler/glusterfs-profiler: Add graphing tool.
glusterfs-profiler is a Python tool that can graphically display
the profiling information printed in the process state dump.

Signed-off-by: Vikas Gorur <vikas@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 268 (Add timing instrumentation code)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=268
2010-04-02 23:11:11 -07:00
Harshavardhana
04f1cd8629 Fix backtick evaluation bug in cache-size
Signed-off-by: Harshavardhana <harsha@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 768 (cache-size might be wrong in glusterfs.vol)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=768
2010-03-29 00:12:24 -07:00
Vikas Gorur
1e55e8f29b extras/volgen: Add copyright headers.
Signed-off-by: Vikas Gorur <vikas@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 751 (Copyright headers missing)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=751
2010-03-24 01:15:45 -07:00
Harshavardhana
4b690df4e2 Fixed "." delimiter for cache-size calculation which would fail on different locale.
Thanks to Filip Valder < valder (a) netdevelo.cz > for suggestions.

Signed-off-by: Harshavardhana <harsha@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 720 (Default . decimal delimiter will not work for other locale)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=720
2010-03-15 22:06:34 -07:00
Pavan Sondur
e66adead70 extras: Add script to be used before using quota translator.
Signed-off-by: Pavan Vilas Sondur <pavan@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 569 (Memory leak in quota translator)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=569
2010-03-09 00:24:57 -08:00
Harshavardhana Ranganath
52aa84d64c Add quota support to volgen
New options on command line
1. --volume-size-server  - Volume sizes for server side posix exports
2. --volume-size-client  - Volume sizes for client side exports

Signed-off-by: Harshavardhana <harsha@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 611 (Add quota support to volgen)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=611
2010-02-18 08:40:07 -08:00
Harshavardhana Ranganath
961cb224dd Remove dns lookup issued for each hostnames.
Signed-off-by: Harshavardhana <harsha@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 563 (glusterfs-volgen: can't handle multiple network interfaces)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=563
2010-02-18 08:40:03 -08:00
Harshavardhana Ranganath
3eef8dfd1b Fix occurence of cache-size being floating point
Signed-off-by: Harshavardhana <harsha@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 516 (cache-size should not be hard-coded to 1GB)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=516
2010-01-25 04:32:19 -08:00
Harshavardhana Ranganath
ab8cabcd30 Cache size is now dynamic and is 20% of the total memory on the client side.
Signed-off-by: Harshavardhana <harsha@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 516 (cache-size should not be hard-coded to 1GB)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=516
2010-01-21 07:45:40 -08:00
Pavan Sondur
a6a1f596a4 extras: Add defrag scripts to the repository
Signed-off-by: Pavan Vilas Sondur <pavan@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 478 (Add defrag scripts into glusterfs)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=478
2010-01-19 05:56:39 -08:00
Vijay Bellur
f0a026b837 Changed occurrences of Z Research to Gluster
Signed-off-by: Vijay Bellur <vijay@gluster.com>
2009-12-07 06:09:02 -08:00
Harshavardhana Ranganath
9cedbb537f Fix critical argument validation bug found during initial testing.
Signed-off-by: Harshavardhana <harsha@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 437 (Fix critical argument validation check on Fedora11 systems)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=437
2009-12-06 02:30:13 -08:00
Harshavardhana Ranganath
a2d7ca2ee2 glusterfs-volgen honours now build level prefix.
Signed-off-by: Harshavardhana <harsha@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 437 (Fix critical argument validation check on Fedora11 systems)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=437
2009-12-06 02:30:10 -08:00
Raghavendra G
b491da7cc5 extras/benchmarking: port glfs-bm.c to master.
Signed-off-by: Raghavendra G <raghavendra@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 422 (port glfs-bm to latest code-base)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=422
2009-12-01 17:52:36 -08:00
Harshavardhana Ranganath
90cebe1938 Booster configuration fixed for per transport type and honours conf-dir option.
Signed-off-by: Harshavardhana <harsha@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 421 (Make booster configuration honour conf-dir and transport type)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=421
2009-12-01 09:22:34 -08:00
Harshavardhana Ranganath
4b363f1c96 Removed deprecated export_dir in print string.
Signed-off-by: Harshavardhana <harsha@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 412 (Remove deprecated export_dir in print string)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=412
2009-11-28 09:25:45 -08:00
Harshavardhana Ranganath
03949adaf0 Volgen rewritten using option parser and added proper support for booster.
Signed-off-by: Harshavardhana <harsha@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 411 (Rewrite volgen using option parser and extend cifs/nfs support)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=411
2009-11-26 11:29:54 -08:00
Harshavardhana Ranganath
057c071403 Volgen supporting multidisks and booster configuration for nfs and cifs
Signed-off-by: Harshavardhana <harsha@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 396 (Volgen multiple export directory support)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=396
2009-11-26 03:04:22 -08:00
Paul Rawson
83598e6015 Fix Redhat init file so that it knows the correct binary location
Signed-off-by: Paul Rawson <plrca2@gmail.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 388 (Redhat initfile fix)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=388
2009-11-19 03:23:19 -08:00
Vikas Gorur
2e7fc582cd extras/glusterfs-volgen: Make the script more user-friendly.
Error messages now print more detail.
Details of export/mount files written is also printed.

Also adds a new option '--version'.

Signed-off-by: Vikas Gorur <vikas@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 343 (Placeholder bug for adding volgen into rpm, bdb makefile changes, etc)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=343
2009-11-13 02:13:50 -08:00
Pavan Sondur
ef078a3359 Add glusterfs-volgen to master, change fusermount options and other changes to rpm spec file.
The patch has the following changes:
* Rename glusterfs-volgen.py and include it in the rpm spec file
* Enable fusermount by default. Change fusermount configure option from disable to enable.
* Remove BDB from configure.ac, essentially removing it from the normal build.
* Remove all dependencies on fuse in the rpm spec file.

Signed-off-by: Pavan Vilas Sondur <pavan@gluster.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 343 (Placeholder bug for adding volgen into rpm, bdb makefile changes, etc)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=343
2009-11-11 23:18:19 -08:00
Corentin Chary
2b610a095f volgen: remove trailing whitespace
Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>
2009-10-30 03:51:48 -07:00
Corentin Chary
ef79f934c3 volgen: Add conf-dir option
Add a conf-dir option to change the output directory for
generated files.

Signed-off-by: Corentin Chary <corentin.chary@gmail.com>
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>
2009-10-30 03:51:47 -07:00
Pavan Sondur
7e66ba43d7 Add glusterfs-volgen to master
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 343 (GlusterFS volume generator - 'volgen')
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=343
2009-10-28 06:40:36 -07:00
Anand V. Avati
5674c41b3e extras/init.d: make install directory configurable with --with-initdir 2009-10-27 05:52:16 -07:00
Vijay Bellur
0b1197defa Changed occurrences of Z Research to Gluster.
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>
2009-10-07 03:54:49 -07:00
Shehjar Tikoo
a5f0b3d7d1 extras: Add LD_PRELOAD test tool
This tool allows us to check the sanity of the LD_PRELOAD
mechanism so that we can be sure that an application's syscalls
will be redirected into booster when that library is LD_PRELOADed.

In case of failed syscalls, this tool should be run first
to see if the calls are redirected as required.

Signed-off-by: Anand V. Avati <avati@dev.gluster.com>

BUG: 251 (Improve booster debugging through ld-preload testing tool)
URL: http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=251
2009-09-15 00:01:50 -07:00
Harshavardhana
f5d0e815b4 Remove absolute path for init scripts.
Signed-off-by: Anand V. Avati <avati@dev.gluster.com>
2009-05-29 02:28:26 -07:00
Harshavardhana
ce653eadc2 modified init scripts to honour @prefix@
fixes http://savannah.nongnu.org/bugs/?26581

Signed-off-by: Anand V. Avati <avati@amp.gluster.com>
2009-05-16 15:32:44 +05:30
Anand V. Avati
adb56cb5e0 backend-xattr-sanitize.sh: script added to extras/
Run the script as:

sh$ ./backend-xattr-sanitize.sh /data/export0

and it will remove all the known stale xattrs on the backend files and dirs
2009-05-07 15:12:09 +05:30
Anand V. Avati
d886ceb9cb minor build fix - set EXTRA_DIST to point to MacOSX/Portfile instead of Portfile 2009-04-23 11:09:37 +05:30
Harshavardhana
86fff0e75b Add MacOSX based packaging file into repo
Signed-off-by: Anand V. Avati <avati@amp.gluster.com>
2009-04-22 17:19:50 +05:30
Anand V. Avati
fb5cc405ae enhancement to migrate-unify-to-distribute.sh 2009-04-18 11:42:52 +05:30
Amar Tumballi
093141a749 added migration script from unify based setup to distribute based setup
Signed-off-by: Anand V. Avati <avati@amp.gluster.com>
2009-04-18 11:15:23 +05:30
Harshavardhana
6bd53940d1 Renamed abs_top_srcdir to top_srcdir for older versions of autotool
Signed-off-by: Anand V. Avati <avati@amp.gluster.com>
2009-04-17 13:45:18 +05:30
Harshavardhana
d170334473 Fixed the build problems observed
Signed-off-by: Anand V. Avati <avati@amp.gluster.com>
2009-04-16 14:54:21 +05:30
Harshavardhana
8123c90701 Commit package making files for FreeBSD and Solaris platform.
Commit for package making related files for FreeBSD and Solaris. These files
are supposed to be in repository to not loose track and update them as needed.
I will update them soon for upcoming release where we support Solaris on
ib fabric also.

Signed-off-by: Anand V. Avati <avati@amp.gluster.com>
2009-04-08 15:06:56 +05:30
Harshavardhana
ae378b63c0 Fixed build problems for init script installation.
Fixed build problem for init scripts (Reported by Krishna and Vikas).

Signed-off-by: Anand V. Avati <avati@amp.gluster.com>
2009-03-09 17:45:56 +05:30
Harshavardhana
da71d1359c Added proper handling for the init scripts for (Debian, Ubuntu, SuSE, Redhat), SuSE init script also added.
* Init scripts added for Debian, Redhat, SuSE distribution, each are installed
  by checking each distribution specific.

Tested on
1. Debian, Ubuntu.
2. Redhat, CentOS.
3. OpenSUSE.

Signed-off-by: Anand V. Avati <avati@amp.gluster.com>
2009-03-03 11:44:21 +05:30