NTP change on  Exadata db nodes

# grep ^server /etc/ntp.conf

server 10.120.0.10 prefer iburst burst minpoll 4 maxpoll 4
server 10.120.2.1 iburst burst minpoll 4 maxpoll 4
server 10.120.2.2 iburst burst minpoll 4 maxpoll 4


Modify the servers in /etc/ntp.conf

Now we can restart the ntp server.

# /etc/init.d/ntpd restart
Shutting down ntpd:                        [ OK ]
ntpd: Synchronizing with timer server:     [ OK ]
Starting ntpd:                             [ OK ]




To force update time


# ntpd -gq
-g requests an update irrespective of the time offset, and -q requests the daemon to quit after updating the date from the ntp server.




************************************************************************************************************************************************
NTP change in storage cells

server 10.120.0.10 prefer iburst burst minpoll 4 maxpoll 4
server 10.120.2.1 iburst burst minpoll 4 maxpoll 4
server 10.120.2.2 iburst burst minpoll 4 maxpoll 4



Log in as the root user.

####Check status

cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome

####Make grid disks inactive

cellcli -e alter griddisk all inactive

####Verify if offline

cellcli -e list griddisk

cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome

####Shut down services

cellcli -e alter cell shutdown services all

service ocrvottargetd stop

####Change NTP settings as above

/usr/local/bin/ipconf


####Verify NTP settings

grep ^server /etc/ntp.conf

####Startup services

service ocrvottargetd start

cellcli -e alter cell startup services all

####Make grid disks online

cellcli -e alter griddisk all active

####Verify grid disks are online

cellcli -e list griddisk

cellcli -e list griddisk attributes name, asmmodestatus


After this if time is still wrong force update it

service ntpd stop
ntpd -gq
service ntpd start


Once everything is synced and online repeast same steps on other cells..



******************************************************************************

[root@xxx ~]# cellcli -e alter cell shutdown services all

Stopping the RS, CELLSRV, and MS services...
The SHUTDOWN of services was successful.
[root@xxx ~]# service ocrvottargetd stop
ocrvottargetd: unrecognized service
[root@xxx ~]# /usr/local/bin/ipconf
[Info]: ipconf command line: /opt/oracle.cellos/ipconf.pl -nocodes
Logging started to /var/log/cellos/ipconf.log
Interface ib0   is                      Linked.    hca: mlx4_0
Interface ib1   is                      Linked.    hca: mlx4_0
Interface eth0  is                      Linked.    driver/mac: ixgbe/00:10:e0:b4:18:ac
Interface eth1  is .................... Unlinked.  driver/mac: ixgbe/00:10:e0:b4:18:ad
Interface eth2  is .................... Unlinked.  driver/mac: ixgbe/00:10:e0:b4:18:ae
Interface eth3  is .................... Unlinked.  driver/mac: ixgbe/00:10:e0:b4:18:af

Network interfaces
Name  State
ib0   Linked
ib1   Linked
eth0  Linked
eth1  Unlinked
eth2  Unlinked
eth3  Unlinked
[Warning]: Some network interface(s) are disconnected. Check cables and swicthes and retry
Do you want to retry (y/n) [y]: n

The current nameserver(s): 10.120.11.6 10.120.11.7
Do you want to change it (y/n) [n]:
The current timezone: America/Los_Angeles
Do you want to change it (y/n) [n]:
The current NTP server(s): 10.120.0.10 216.239.32.15
Do you want to change it (y/n) [n]: y
Fully qualified hostname or ip address for NTP server. Press enter if none: 10.120.0.10
Continue adding more ntp servers (y/n) [n]: y
Fully qualified hostname or ip address for NTP server. Press enter if none: 10.120.2.1
Continue adding more ntp servers (y/n) [n]: y
Fully qualified hostname or ip address for NTP server. Press enter if none: 10.120.2.2
Continue adding more ntp servers (y/n) [n]:

Network interfaces
Name  State    Status  IP address    Netmask       Gateway     Net type   Hostname
ib0   Linked   UP      192.168.10.26 255.255.252.0             Private    xxx-priv1.hke.local
ib1   Linked   UP      192.168.10.27 255.255.252.0             Private    xxx-priv2.hke.local
eth0  Linked   UP      10.120.16.203 255.255.255.0 10.120.16.1 Management xxx.hke.local
eth1  Unlinked UNCONF
eth2  Unlinked UNCONF
eth3  Unlinked UNCONF
Select interface name to configure or press Enter to continue:

Select canonical hostname from the list below
1: xxx-priv1.hke.local
2: xxx-priv2.hke.local
3: xxx.hke.local
Canonical fully qualified domain name [3]:

Select default gateway interface from the list below
1: eth0
Default gateway interface [1]:

Canonical hostname: xxx.hke.local
Nameservers: 10.120.11.6 10.120.11.7
Timezone: America/Los_Angeles
NTP servers: 10.120.0.10 10.120.2.1 10.120.2.2
Default gateway device: eth0
Network interfaces
Name  State    Status  IP address    Netmask       Gateway     Net type   Hostname
ib0   Linked   UP      192.168.10.26 255.255.252.0             Private    xxx-priv1.hke.local
ib1   Linked   UP      192.168.10.27 255.255.252.0             Private    xxx-priv2.hke.local
eth0  Linked   UP      10.120.16.203 255.255.255.0 10.120.16.1 Management xxx.hke.local
eth1  Unlinked UNCONF
eth2  Unlinked UNCONF
eth3  Unlinked UNCONF
Is this correct (y/n) [y]:

Do you want to configure basic ILOM settings (y/n) [y]:
Loading basic configuration settings from ILOM ...
ILOM Fully qualified hostname [xxx-ilom.hke.local]:
Inet protocol (IPv4,IPv6) [IPv4]:
ILOM IP address [10.120.16.11]:
ILOM Netmask [255.255.255.0]:
ILOM Gateway or none [10.120.16.1]:
ILOM Nameserver (multiple IPs separated by a comma) or none [10.120.11.6]:
ILOM Use NTP Servers (enabled/disabled) [enabled]:
ILOM First NTP server. Fully qualified hostname or ip address or none [10.120.0.10]:
ILOM Second NTP server. Fully qualified hostname or ip address or none [216.239.32.15]: 10.120.2.1
ILOM Vlan id or zero for non-tagged VLAN (0-4079) [0]:

Basic ILOM configuration settings:
Hostname             : xxx-ilom.hke.local
IP Address           : 10.120.16.11
Netmask              : 255.255.255.0
Gateway              : 10.120.16.1
DNS servers          : 10.120.11.6
Use NTP servers      : enabled
First NTP server     : 10.120.0.10
Second NTP server    : 10.120.2.1
Timezone (read-only) : America/Los_Angeles
VLAN id              : 0
Is this correct (y/n) [y]:

[Info]: Run /opt/oracle.cellos/validations/init.d/saveconfig
[Info]: Stopping cellwall service ...
cellwall: Flushing firewall rules:                         [  OK  ]
[Info]: cellwall service stopped
[Info]: Restart ntpd service
Shutting down ntpd:                                        [  OK  ]
Starting ntpd:                                             [  OK  ]
[Info]: Starting cellwall service ...
cellwall: Checking network interfaces:                     [  OK  ]
cellwall: Checking ILOM interface:                         [  OK  ]
cellwall: Flushing firewall rules:                         [  OK  ]
cellwall: Applying firewall rules:                         [  OK  ]
[Info]: cellwall service started
[Info]: Save /etc/sysctl.conf in /etc/sysctl.conf.backupbyExadata
[Info]: Adjust settings for IB interfaces in /etc/sysctl.conf
Re-login using new IP address 10.120.16.203 if you were disconnected after following commands
ip addr show eth0
sleep 4

[Warning]: You modified NTP server.
         Ensure you also update the Infiniband Switch NTP server
         if the same NTP server was also used by the Infiniband switch.







*****************************************************************************************************
NTP change in Infiniband switches


Login to infiniband using ilom-admin user default password is welcome1


check existing ntp configuration

show -d properties /SP/clients/ntp/server/1
show -d properties /SP/clients/ntp/server/2


check ntp status

show -d properties /SP/clock

To check current time

show /SP/clock datetime


Change ntp server address

set /SP/clients/ntp/server/1 address=10.120.0.10

set /SP/clients/ntp/server/2 address=10.120.2.1


*****************************************************************************************************

On solaris

ntpq -p

this lists ntp servers

cd /etc/inet

vi ntp.conf

edit the servers to new servers

Example:

server 10.120.2.1 prefer
server 10.120.2.2

After this save the file.

Now disable and enable ntpd

svcadm disable ntp

svcadm enable ntp

verify time servers

ntpq -p

date