DPOD's Big Data Store is located on a dedicated hard drive. Occasionally, the disk space allocated for the Store needs to be increased. Reasons for that include an increase in TPS, or a requirement to retain history for longer periods of time.
The process to increase the disk space allocated to DPOD's Store entails the two stages detailed below:
Increase the Data Disk and File System
Physical Server
Use the server vendor's RAID management software to extend the existing RAID Disk (LUN) or add new RAID Disk (new LUN), in order to increase the data disk and file system sizes for the physical server.
Select the correct OS level configuration procedure below, based on whether you selected to extend or add a disk.
Virtual appliance
With a virtual deployment, there are two options available for increasing DPOD's Store disk space:
Extend The Existing Virtual Disk
Use the vSphere Client in order to edit the DPOD virtual machine
- Stop the DPOD virtual machine.
- Select Edit virtual machine settings
- Select the 3rd hard drive (which is the data disk, as described in the Hardware and Software Requirements page).
- Increase the Provisioned size of the hard drive and press OK.
- Wait for the increase process to finish.
- Start the DPOD virtual machine.
Configure the extended disk at the OS level
Verify the current size of mount point /data:
df -h /data
The system output should resemble the following:
Verify the new disk size:
fdisk -l |grep /dev/sdc
The system output should resemble the following:
Use fdisk to create a new partition for the new size:
fdisk /dev/sdc
and perform the following steps:
- Press p to print the partition table to identify the number of partitions:
If this is the first time the disk is extended, you should only see sdc1. If this is a subsequent extension - you will see additional sdcX listed (e.g. sdc2 for the second extension) - Press n to create a new primary partition.
- Press p for primary.
- When the system prompts for a partition number, enter the next number depending on the output of the partition table print.
If this is the first extension and you see only one row of output - enter 2. If this is the second disk extension then the partition number will be 3, and so on. - Press Enter twice
- Press t to change the system's partition ID.
- Press 2 to select the newly created partition (Remember: if this is a subsequent disk extension - the number will be 3 or higher)
- Type 8e to change the Hex Code of the partition for Linux LVM.
Press w to write the changes to the partition table.
the following warning is valid, the system reboot will fix the issue :
“WARNING: Re-reading the partition table failed with error 16: Device or resource busy.The kernel still uses the old table. The new table will be used at the next reboot or after you run partprobe(8) or kpartx(8)”Reboot the system:
reboot
When the system is back up, ensure the new partition is available:
fdisk -l | grep /dev/sdc
The system output should resemble the following (note the new sdcX added)
Stop the application by running app-util.sh and selecting option 2 (stop all)
If the new partition is not sdc2, substitute sdc2 for the right qualifier in all the following commands
Create a new LVM Physical Volume (PV):
pvcreate /dev/sdc2
Extend the LVM Volume Group (VG):
vgextend vg_data /dev/sdc2
Extend the LVM Logical Volume (LV):
lvextend -l +100%FREE /dev/vg_data/lv_data
Identify the /data file system type (for CentOS 7.2 based appliance the type is xfs):
cat /etc/fstab |grep /data
The system output should resemble the following:
Resize the file system. Select the correct command below for your file system type:
ext4resize2fs /dev/vg_data/lv_data
xfsxfs_growfs /dev/vg_data/lv_data
The system output should resemble the following:
To display the new size of the /data mount point:
df -h /data
- Press p to print the partition table to identify the number of partitions:
Add new virtual disk
Use the vSphere Client in order to edit the DPODs virtual machine
- Stop DPOD virtual machine.
- Press “Edit virtual machine settings”
- Choose “add” -> “hard drive”
make sure you configure the new hard drive as “Thick Provision Eager Zeroed” - Wait for the increase process to finish.
- Wait for the increase process to finish.
- Start DPOD virtual machine.
Configure the new disk on OS level
- Display the current size of mount point / data : df -h /data
- Display the current size of mount point / data : df -h /data
- Display the new disk size : fdisk -l |grep /dev/sdd
- Display the new disk size : fdisk -l |grep /dev/sdd
- Create new partition for the new size :
- fdisk /dev/sdd
- Press p to print the partition table and make sure there are no partitions.
- Press n to create a new primary partition.
- Press p for primary.
- Press 1 for the partition number
- Press Enter two times.
- Press t to change the system's partition ID.
- Type 8e to change the Hex Code of the partition for Linux LVM.
Press w to write the changes to the partition table.
- Reboot the system : reboot
- After the system is up, make sure you see the new partition : fdisk -l |grep /dev/sdd
- stop the application using app-util.sh -> option 2 (stop all)
- create new LVM physical volume (PV) : pvcreate /dev/sdd1
- extend the LVM volume group (VG) : vgextend vg_data /dev/sdd1
- extend the LVM logical volume (LV) :
lvextend -l +100%FREE /dev/vg_data/lv_data - identify the /data file system type (for CentOS 7.2 based appliance the type is xfs) : cat /etc/fstab |grep /data
- resize the file system according to the file system type :
- ext4 : resize2fs /dev/vg_data/lv_data
- xfs : xfs_growfs /dev/vg_data/lv_data
- Display the new size of mount point / data : df -h /data
Update the Store Configuration File
Update the Store configuration file :
please run the following script:
/app/scripts/update_store_allocation.sh
The script is available on DPOD v1.0.4.0 and above. If you are using earlier version please contact DPOD support and the script will be provided.
- start the application using app-util.sh -> option 1 (start all)