Topic: ibays, old hdd acces over network (NAS)

[gdh]

hey there, i am fairly new at SME server, so maybe you can clairify my questions.

i installed SME9 on a 40gb SSD, after that i installed 2 HDD, one 1tb one 4 tb. i mounted them via fstab. in home/esmith/files/ibays/...
now i would like to get acces to them, over network (access on the server is ok, tested it). the 1tb HDD should only give access to some speciefied users, witch are in groups already.
the 4tb should be accessible for everyone in the local network.

i guess there are some logical mistakes.

can i use the ibays for liking mounted HDD to specified groups/users?


how can i give access via network to my HDD?

[janet]

gdh

Take a look at the menus along the top of forum pages. There are many links to useful information eg FAQ, Howtos, Contribs as well as the main Wiki page & the Manual.

Please browse through these to see the articles that are available so you are aware at least, about the extent of information that has been provided by many good people.

On the Howto page under A you will find
http://wiki.contribs.org/AddExtraHardDisk

& there is another Howto that refers to SCSI disks

[gdh]

thank you for your post. unfortunately is the given link not requested, i already add my old HDD. by the way, this manual is outdated. no migration of sata disks, ext4 is missing and a part for migrating HDD without the lost of all data is not subscribed. but that is not the point.
the point is how to use the ibays, and can i use these feature for my request?

have you red my question? looks like there is a computer which gives answers to some words...

[janet]

gdh

have you red my question? looks like there is a computer which gives answers to some words...

Did you even bother to read that article ?
See

http://wiki.contribs.org/AddExtraHardDisk#Alternative_2:_Mounting_a_specific_ibay_or_user

... and please drop the attitude !

[TerryF]

I was to slow on the trigger there Janet, you beat me, I was going to point to the same info..you can only do so much

[janet]

gdh

I'm sure you know the difference between hda & sda.
You have to make an effort.
Feel free to improve the documentation, request write access via your forum profile.
Nobody is paid here, all advice is given for free.

[gdh]

jep i red this article, but it doesnt help me.

HDD is already mounted and permissions are given, but i cant still access via network.
tried to mount in home/esmith/files/ibays/...  does not work and do these few steps to make a systemlink. but i stopped at this point:

Code: [Select]

[root@tape privat]# rm -rf /home/e-smith/files/ibays/privat
rm: Entfernen von ���/home/e-smith/files/ibays/privat��� nicht m��glich: Das Ger��t oder die Ressource ist belegt -> not possible, device is busy or in use
most important for me is to keep the data, i have no more disks to save the data


if we finish this datamigration i will update the wiki. but at this point nothing works...

[Stefano]

gdh..

you're trying to do something unusual and unsupported..

anyway, before giving you any kind of instruction, you'd give us as many info as you can.

is your data already on the server?
is there enough free space to make a backup/copy?
do you have a backup copy stored in another place?

but at this point nothing works...

well.. at this point we don't know exactly what you did and you are not helping us to help you

[gdh]

ok, i would like to set up some kind of NAS.

i have ONLY 2 HDD one with 1tb for private data and only user: admin, root, x230,x301,t60p and desktop should be able to read and write.
the second HDD is 4TB everyone in the local network should be able to read, but only user: admin, root, x230, x301,t60p and desktop should be able to write.

for this i created 2 groups. one ist security_level_0 ->everyone can read, only group write. ->this is for the 4tb HDD
the 2nd group is security_level_1 ->only group members are able to read and write.

the data is already on these 2 HDD and these to are physically installed into the server, and mounted (4tb in /home/e-smith/files/ibays/gemeinsam, 1tb treid to do these system linking, like the wiki manual)

I have no more HDD/space to make a copy of the 4TB, the 1TB is already backed up

no copy/backup in another place


why is this action something unusual/unsupported? its just like a small NAS/samba server, or am i wrong?


now ATM the status is, i can see the server in the network from windows and linux machines, but cannot access the ibay folder. there popped up something like you are not authorized. doesent matter which account i use (desktop, admin, x230)

[Stefano]

post here your /etc/fstab file

[gdh]

Code: [Select]

# /etc/fstab
# Created by anaconda on Sun Apr  5 12:15:22 2015
#
# Accessible filesystems, by reference, are maintained under '/dev/disk'
# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info
#
/dev/mapper/main-root   /                       ext4    usrquota,grpquota      $
UUID=a0e403d2-4221-4c27-a6d9-467b30a78826 /boot                   ext4    defau$
/dev/mapper/main-swap   swap                    swap    defaults 0 0
tmpfs                   /dev/shm                tmpfs   defaults 0 0
devpts                  /dev/pts                devpts  gid=5,mode=620  0 0
sysfs                   /sys                    sysfs   defaults 0 0
proc                    /proc                   proc    defaults 0 0
/dev/sda1 /home/e-smith/files/ibays/privat ext4 usrquota,grpquota 1 1
/dev/sdc1 /home/e-smith/files/ibays/gemeinsam ext4 usrquota,grpquota 1 1



[Stefano]

ok

try

Code: [Select]

signal-event ibay-modify privat
signal-event ibay-modify gemeinsam

then reboot your client (is it windows?) and try again..

[idp_qbn]

gdh
If you want to continue with the SSD 40Gb drive as the OS and use the others just for data, perhaps you should look at using FreeNAS, which does that very well indeed.

SME is better because it allows you to do much more, IF YOU FOLLOW ITS RULES.

My suggestion for you is to get 4 big SATA drives (2Tb at least) and set up a RAID 5 Smeserver.
Have 2 ibays and 2 groups. Give each group access to its own ibay and not to the other.
You can put a user into both groups, which gives them access to both ibays.
Very simple, very elegant, very controllable.
No need to go inventing your own system.
This is what SME was designed for.

Remember, if a path is well trodden that's because it leads somewhere useful.

Cheers and good luck.
Ian
ps : As the old proverb goes: "Good Luck comes to those who Read The Manual".

[TerryF]

ps : As the old proverb goes: "Good Luck comes to those who Read The Manual".

Have to add to that, "and also cometh the answers"

[DanB35]

SME is better because it allows you to do much more, IF YOU FOLLOW ITS RULES.

I don't think it's accurate to say either that SME is better, or that it allows you to do more, than FreeNAS.  They're different systems, designed for different (although slightly overlapping) purposes.  SME does some things better, while FreeNAS does others better.

If anything, I'd say that FreeNAS allows you to do more, because you can install whatever software you want in a jail.  Want a public-facing web and mail server?  No problem--but you'll have to configure it yourself.  Want VirtualBox?  Click two buttons and enter a hostname.  If it'll run on Linux and it's Free Software, there's a 99+% chance it'll run on FreeBSD (and thus in a FreeNAS jail) too.  And with VirtualBox, if it won't run on FreeBSD, you can build a VM of whatever OS you want that it will run on.

SME certainly has its advantages.  It's an excellent choice for a pushbutton-simple, secure, NAT router and SMB web/mail/file server.  I wish it did ZFS, and it'd be really nice if it were designed to use a small boot/system device, combined with a larger storage device/pool, but it is what it is, and it works well enough for me that I've been using it for 15+ years.

FreeNAS has its advantages as well.  It supports more network protocols than SME (AFP, NFS, iSCSI, rsync, WebDAV), for one.  It uses ZFS, for another (and that's huge).  Replacement of failed drives (or replacing drives with larger drives to expand your pool) is pushbutton simple.  The architecture is of an appliance, and any changes you make or software you add is in a separate jail which doesn't interfere with the primary OS.  The developers make available a bunch of additional packages a plugins, making installation a point-and-click affair.

At the end of the day, there's very little that can be done in SME and not in FreeNAS, or that can be done in FreeNAS and not in SME.  But the set of things that are easy in each system is quite different.  You may well find, as I have, that the best course of action is to use both.

[Daniel B.]

@gdh: you haven't told us exactly what's not working as you expect, but, from a quick look at your fstab, you've mounted your two additional drives in the root of the ibay (/dev/sda1 => /home/e-smith/files/ibays/privat and /dev/sdc => /home/e-smith/files/ibays/gemeinsam), my guess is that your drives do not have the expected top level "files" directory, but all your data is directly at the root of your drive. If that's the case, just mount your drive in the "files" directory of the ibay

Code: [Select]

/dev/sda1 /home/e-smith/files/ibays/privat/files ext4 usrquota,grpquota 1 1
/dev/sdc1 /home/e-smith/files/ibays/gemeinsam/files ext4 usrquota,grpquota 1 1

Then run

Code: [Select]

signal-event ibay-modify privat
signal-event ibay-modify gemeinsam

(This last command will update the permissions to those set on this ibays through the server-manager)

[gdh]

thank you all very much, i will try it, but at the moment i am 3 weeks in paris...

i have more plans with the sme than only local file access. i think sme fits perfect.

[idp_qbn]

Daniel B. :
An excellent summary! Thank you.
Now gdh should know he has a choice of (at least two) well established solutions and does not have to develop his own. Both SME and FreeNAS have large user-bases and excellent forums to offer assistance.

So, read the manual, do some planning, follow the guidelines and .... voila! Job done!

gdh : enjoy Paris, lucky sod!

Cheers
Ian

[gdh]

hey guys, back from my paris trip i tried something. and for the moment it seems to work.

i did:

Code: [Select]

/dev/sda1 /home/e-smith/files/ibays/privat/files ext4 usrquota,grpquota 0 0
/dev/sdc1 /home/e-smith/files/ibays/gemeinsam/files ext4 usrquota,grpquota 0 0
in etc/fstab

then:

Code: [Select]

signal-event ibay-modify privat
signal-event ibay-modify gemeinsam
then:

Code: [Select]

yum --enablerepo=smecontribs install smeserver-shared-folders

Code: [Select]

signal-event post-upgrade; signal-event reboot
created a folder,
reboot server
deleted the created folder

have access to my HDD

thank you all

[janet]

gdb

....but do you understand why ?

Each ibay has 3 folders created by the system when a new ibay is created ie
../ibayname/files
../ibayname/cgi-bin
../ibayname/html

These are hidden from view using samba when the ibay is not configured for Internet access, but any files you save or create are actually saved in ../ibayname/files folder.

When you enable Internet access for an ibay, in samba these three folders are visible & you need to select the required location (folder name) in which to save your data.
Normal data for local network file sharing would be saved to the ../files folder, data for web pages would be saved to the ../html folder & cgi code for web pages is saved to ../cgi-bin

You can see all this if you login at the command prompt as root & view the folder structure of ibays that have different Internet settings.

So when you originally mounted the drive to .../ibayname you did not have the three system folders on that drive, so SME server could not work as designed, thus the error you received.

[gdh]

actually i really dont understand why its now working...

but i guess it has something to do with that shared folders thing.

i did the first steps until signal-event, reboot
-> same error appears

with shared folders it works.

@ janet ahhh ok thank you



another few questions:
is there a possibility to put on a downloader. something like jdownloader, pyLoad.... for one click hoster on SME?

what is the propper way to install trusted software? via webinterface (https:server/server-manager) or via terminal and yum.
i would like to browse some software, maybe i find someone who already created something, which fits to my needs (then there is no need to start from scratch)

[gdh]

hey,
it seems, my work isnt working properly

if i put files on the server, its placed on the wrong disk.

example:
from a windows machine i go to network -> sme server -> gemeinsam (ibay name) -> found the files on the 4tb disk.
now i add some files (was over 40gb) and i got an error, not enough disk space. (there should be more than 1tb).

i checked the 40gb system ssd and it was absolutely full. so the copied files wasnt copied to the 4tb. there were copied to the system ssd. (i dont want this)




so i bought another 4tb hdd to have a clean one for backups. (external, not in the server)
i reinstalled SME server 9.
i did

Code: [Select]

mkdir /mnt/4tb; mkdir /mnt/1tb
in fstab i add

Code: [Select]

/dev/sda1 /mnt/1tb usrquota,groquota 1 2
/dev/sdc1 /mnt/4tb usrquota,groquota 1 2

i rebooted and before it starts properly i got an error message during restart:
checking datasystems
/dev/sdc1 is in use.
e2fsck: continue not possible

/dev/sda1 is in use.
e2fsck: continue not possible.

during checking of datasystem occours an error. you will redirected to a shell.
give root password for maintenance



(maybe its not 100% word by word. my display is in german, tried to translate in english)

any ideas?

[janet]

gdh

You said
/dev/sda1 /mnt/1tb usrquota,groquota 1 2
/dev/sdc1 /mnt/4tb usrquota,groquota 1 2

Is that a genuine mispelling or typo(s), it should be
grpquota

Edit:
Also it is a better approach to keep troubleshooting your existing setup, rather than reinstalling & changing your setup & then start to troubleshoot that new setup.

The goal posts keep changing, which makes it harder for others to help you.

[gdh]

oh sry i typed wrong into the forum. it is correct on the fstab.

the setup is still the same. 1tb HDD for private shared data; 4tb HDD for local public data; 40gb SDD for system
the difference now is, i can format everything (external HDD, which i bought, is for backup purpose)

the goal is the same.
i want to mount the 2 HDD (1tb;4tb)
i want to have access via LAN from other machines to the 2 HDD
i want to be able to put new data on the 2 HDD
i want to set permissions to the 2 HDD (1tb, private only from special users, 4tb for everyone in local network)


so for the moment i re installed SME9 again. no changes...

Code: [Select]

df -T
[root@tape ~]# df -T
Filesystem           Type  1K-blocks    Used Available Use% Mounted on
/dev/mapper/main-root
                     ext4   30406684 1557132  27304952   6% /
tmpfs                tmpfs   3945352       0   3945352   0% /dev/shm
/dev/md0             ext4     247855   28550    206509  13% /boot


Code: [Select]

[root@tape ~]# mount -l
/dev/mapper/main-root on / type ext4 (rw,usrquota,grpquota)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/md0 on /boot type ext4 (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)


Code: [Select]

# /etc/fstab
# Created by anaconda on Sun Apr 19 19:45:45 2015
#
# Accessible filesystems, by reference, are maintained under '/dev/disk'
# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info
#
/dev/mapper/main-root   /                       ext4    usrquota,grpquota      $
UUID=990223be-580d-48d4-9dc3-b78eb23b3818 /boot                   ext4    defau$
/dev/mapper/main-swap   swap                    swap    defaults 0 0
tmpfs                   /dev/shm                tmpfs   defaults 0 0
devpts                  /dev/pts                devpts  gid=5,mode=620  0 0
sysfs                   /sys                    sysfs   defaults 0 0
proc                    /proc                   proc    defaults 0 0


i tried to fullow this guideline http://wiki.contribs.org/AddExtraHardDisk
but i got the error in the post before....

while the installation of SME9, the 2 HDD were not formatted. now we can format it. but i am very unsure about the 4tb HDD. some other linux dist. have huge problems with the 4tb.

[janet]

gdh

I suggest you try using only one drive first, ie the 1Tb drive.

After installing sme to the SSD, you would then connect the HDD & format it ext4
then you would follow the howto, there is no reason it should not work.

Rather than say verbally what you did, please post exact steps & commands you entered, & it is better to copy (& paste) them from the history rather than retyping them, that way we can see the actual comands you really did issue. In Putty you can copy the commands issued.

Re 4Tb drive (or drives equal or greater than 2Tb), sme9 wil handle those OK, but you need to partition/format using GPT, there is a procedure to follow (search forums on GPT), but I suggest you leave that till later when you sort out using the 1Tb drive.

[gdh]

ok

the HDDs are already connected to the system and formatted to ext4.

re format anyway?

[janet]

gdh

No need to format again.
Just show us output of
fdisk -l

After that please remove the 4Tb drive & set up your mapping just using the 1Tb drive, to prove your procedures are correct.

[gdh]

Code: [Select]

[root@tape /]# fdisk -l

Platte /dev/sda: 1000.2 GByte, 1000204886016 Byte
255 K��pfe, 63 Sektoren/Spur, 121601 Zylinder
Einheiten = Zylinder von 16065 �� 512 = 8225280 Bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000cade4

   Ger��t  boot.     Anfang        Ende     Bl��cke   Id  System
/dev/sda1   *           1          32      256000   fd  Linux raid autodetect
Partition 1 endet nicht an einer Zylindergrenze.
/dev/sda2              32      121602   976504832   fd  Linux raid autodetect

Platte /dev/sdb: 40.0 GByte, 40020664320 Byte
255 K��pfe, 63 Sektoren/Spur, 4865 Zylinder
Einheiten = Zylinder von 16065 �� 512 = 8225280 Bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000aec50

   Ger��t  boot.     Anfang        Ende     Bl��cke   Id  System
/dev/sdb1   *           1          32      256000   fd  Linux raid autodetect
Partition 1 endet nicht an einer Zylindergrenze.
/dev/sdb2              32        4866    38824960   fd  Linux raid autodetect

WARNING: GPT (GUID Partition Table) detected on '/dev/sdc'! The util fdisk doesn't support GPT. Use GNU Parted.


Platte /dev/sdc: 4000.8 GByte, 4000787030016 Byte
255 K��pfe, 63 Sektoren/Spur, 486401 Zylinder
Einheiten = Zylinder von 16065 �� 512 = 8225280 Bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000

   Ger��t  boot.     Anfang        Ende     Bl��cke   Id  System
/dev/sdc1               1      267350  2147483647+  ee  GPT
Partition 1 does not start on physical sector boundary.

Platte /dev/md1: 39.7 GByte, 39723073536 Byte
2 K��pfe, 4 Sektoren/Spur, 9698016 Zylinder
Einheiten = Zylinder von 8 �� 512 = 4096 Bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000


Platte /dev/mapper/main-root: 31.6 GByte, 31633440768 Byte
255 K��pfe, 63 Sektoren/Spur, 3845 Zylinder
Einheiten = Zylinder von 16065 �� 512 = 8225280 Bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000


Platte /dev/mapper/main-swap: 8086 MByte, 8086618112 Byte
255 K��pfe, 63 Sektoren/Spur, 983 Zylinder
Einheiten = Zylinder von 16065 �� 512 = 8225280 Bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000


Platte /dev/md0: 262 MByte, 262078464 Byte
2 K��pfe, 4 Sektoren/Spur, 63984 Zylinder
Einheiten = Zylinder von 8 �� 512 = 4096 Bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000


[janet]

gdh

Show output of
cat /proc/mdstat

[gdh]

Code: [Select]

[root@tape /]# cat /proc/mdstat
Personalities : [raid1]
md0 : active raid1 sdc1[2] sdb1[1] sda1[0]
      255936 blocks super 1.0 [3/3] [UUU]
     
md1 : active raid1 sda2[0] sdc2[2] sdb2[1]
      38792064 blocks super 1.1 [3/3] [UUU]
      bitmap: 0/1 pages [0KB], 65536KB chunk

unused devices: <none>


[janet]

gdh

Looks like you have made a RAID1 array out of the 3 disks, sda, sdb & sdc (2 + spare).

That happens when you connect the 3 disks inside the server & then do an install from CD media.
The installer sees the 3 drives & automatically decides to create a RAID1 array.
That is normal behaviour.

That's also why you get drive busy errors when you sperately try to mount the drives.

OK, you need to disconnect the 2 physical drives (1Tb & 4Tb), then reinstall from CD to the 40Gb SSD (with no other drives connected).

Then after 1st boot & configuration, shut down the server & physically reconnect the 1Tb drive.

You should zero out the MBR on any already used drive, so be sure to do that see,
http://wiki.contribs.org/Raid#Reusing_Hard_Drives

Then follow the Howto steps & get it all working with one additional drive.

When all good, shutdown the server & connect the 4Tb drive & follow the same procedure (using GPT).

Remember you will have this same issue if you do full version upgrades in future, so you have to disconnect extra drives before installing from media.

[janet]

gdh

What is the outcome now, working better ?

[gdh]

sry for no answer... had a request in paris again 

i gues  at friday, i can give an answer.


THANKS for your help!

[gdh]

hi janet,
sry for my late response... was a bit busy in the past few month.

i reinstalled SME, like u said and plugged in the 1tb harddisk after installation and configuration.

fstab:

Code: [Select]

/dev/mapper/main-root   /                       ext4    usrquota,grpquota      $
UUID=bd2f9d1c-a11e-4218-ac19-8d9452a6b2ae /boot                   ext4    defau$
/dev/mapper/main-swap   swap                    swap    defaults        0 0
tmpfs                   /dev/shm                tmpfs   defaults        0 0
devpts                  /dev/pts                devpts  gid=5,mode=620  0 0
sysfs                   /sys                    sysfs   defaults        0 0
proc                    /proc                   proc    defaults        0 0
/dev/sdc1 /home/e-smith/files/ibays/tb4/files/tb4 ext4 usrquota,grpquota 0 0
/dev/sda1 /home/e-smith/files/ibays/tb1/files/tb1 ext4 usrquota,grpquota 0 0

tomorrow i will try to get access