Problem When Set DataMemory in MySQL cluster

[Ridd1ck]

When I try to set DataMemory With value greater than 1 GB the nodes cannot connect to the cluster and managment server display's this output:

Node 2: Node shutdown completed, restarting, no start.
Node 2: Node shutdown completed, restarting, no start.
Node 2: Node shutdown completed, restarting, no start.

What Can I do for this?
My Database is Huge 20 Gb in total.

[Wagner Bianchi]

Can you share the cluster log content with us?

Get it on management node machine...

Best wishes,
--
*Wagner Bianchi* - Administrador de Bancos de Dados
*Mobile:* [phone] - 9510
*LinkedIn*: http://br.linkedin.com/in/wagnerbianchi
*Twitter*: @wagnerbianchijr
*Skype*: wbianchijr



2011/11/9 Ridd1ck <[hidden email]>

> When I try to set DataMemory With value greater than 1 GB the nodes cannot
> connect to the cluster and managment server display's this output:
>
> Node 2: Node shutdown completed, restarting, no start.
> Node 2: Node shutdown completed, restarting, no start.
> Node 2: Node shutdown completed, restarting, no start.
>
> What Can I do for this?
> My Database is Huge 20 Gb in total.
>
>
> --
> View this message in context:
> http://mysql-cluster.1050023.n4.nabble.com/Problem-When-Set-DataMemory-in-MySQL-cluster-tp4020307p4020307.html
> Sent from the MySQL - Cluster mailing list archive at Nabble.com.
>
> --
> MySQL Cluster Mailing List
> For list archives: http://lists.mysql.com/cluster
> To unsubscribe:
> http://lists.mysql.com/cluster?unsub=wagnerbianchijr@...
>
>

[Ridd1ck]

, m_reserved_nodes 1 and 3.
2011-11-09 18:38:03 [MgmtSrvr] INFO     -- Node 3: Node shutdown completed, restarting, no start.
2011-11-09 18:38:03 [MgmtSrvr] INFO     -- Mgmt server state: nodeid 3 freed, m_reserved_nodes 1.
2011-11-09 18:38:03 [MgmtSrvr] INFO     -- Mgmt server state: nodeid 3 reserved for ip 192.168.1.20                                        , m_reserved_nodes 1 and 3.
2011-11-09 18:38:03 [MgmtSrvr] INFO     -- Node 3: Node shutdown completed, restarting, no start.
2011-11-09 18:38:03 [MgmtSrvr] INFO     -- Mgmt server state: nodeid 3 freed, m_reserved_nodes 1.
2011-11-09 18:38:03 [MgmtSrvr] INFO     -- Mgmt server state: nodeid 3 reserved for ip 192.168.1.20                                        , m_reserved_nodes 1 and 3.
2011-11-09 18:38:04 [MgmtSrvr] INFO     -- Mgmt server state: nodeid 3 freed, m_reserved_nodes 1.
2011-11-09 18:38:11 [MgmtSrvr] INFO     -- Stopping this node
2011-11-09 18:38:13 [MgmtSrvr] INFO     -- Shutting down server...
2011-11-09 18:38:16 [MgmtSrvr] INFO     -- Shutdown complete
2011-11-09 18:38:20 [MgmtSrvr] INFO     -- Got initial configuration from 'config.ini', will try to                                         set it when all ndb_mgmd(s) started
2011-11-09 18:38:20 [MgmtSrvr] INFO     -- Mgmt server state: nodeid 1 reserved for ip 192.168.1.1,                                         m_reserved_nodes 1.
2011-11-09 18:38:20 [MgmtSrvr] INFO     -- Id: 1, Command port: *:1186
2011-11-09 18:38:20 [MgmtSrvr] INFO     -- Node 1: Node 1 Connected
2011-11-09 18:38:20 [MgmtSrvr] INFO     -- MySQL Cluster Management Server mysql-5.1.56 ndb-7.1.14                                         started
2011-11-09 18:38:20 [MgmtSrvr] INFO     -- Node 1 connected
2011-11-09 18:38:20 [MgmtSrvr] INFO     -- Starting initial configuration change
2011-11-09 18:38:20 [MgmtSrvr] INFO     -- Configuration 1 commited
2011-11-09 18:38:20 [MgmtSrvr] INFO     -- Config change completed! New generation: 1
2011-11-09 18:38:27 [MgmtSrvr] INFO     -- Mgmt server state: nodeid 3 reserved for ip 192.168.1.20                                        , m_reserved_nodes 1 and 3.
2011-11-09 18:38:27 [MgmtSrvr] INFO     -- Node 1: Node 3 Connected
2011-11-09 18:38:28 [MgmtSrvr] ALERT    -- Node 3: Forced node shutdown completed. Occured during s                                        tartphase 0. Caused by error 2327: 'Memory allocation failure, please decrease some configuration p                                        arameters(Configuration error). Permanent error, external action needed'.
2011-11-09 18:38:28 [MgmtSrvr] ALERT    -- Node 1: Node 3 Disconnected
2011-11-09 18:38:29 [MgmtSrvr] INFO     -- Mgmt server state: nodeid 3 freed, m_reserved_nodes 1.
 

this is the last output when i try to set datamemory greater than 1 GB

[Ridd1ck]

When i set the DataMemory=1000M all works perfect
When I try to set DataMemory=2000M i get this error from Managment Server What Can I do for this, i run Cluster in Fedora 15.
Error:
Node 2: Forced node shutdown completed. Occured during startphase 0. Caused by error 2327: 'Memory allocation failure, please decrease some configuration parameters(Configuration error). Permanent error, external action needed'.



Please Help me...........

[Ridd1ck]

Can Anyone Help me?
My problem is when i change DataMemory value >2G nodes cannot connect to cluster and i get this error from managment server:

ndb_mgm>
Node 3: Forced node shutdown completed. Occured during startphase 0. Caused by error 2327: 'Memory allocation failure, please decrease some configuration parameters(Configuration error). Permanent error, external action needed'.


Help me.

[Wagner Bianchi]

You must review your configuration file. The main advise is to start
another config file from the scratch, with just mandatory option under
[ndbd default] options. There is something messing everything inside its
cluster configuration and you haven't seen yet...

Best wishes,
--
*Wagner Bianchi* - Administrador de Bancos de Dados
*Mobile:* [phone] - 9510
*LinkedIn*: http://br.linkedin.com/in/wagnerbianchi
*Twitter*: @wagnerbianchijr
*Skype*: wbianchijr



2011/11/11 Ridd1ck <[hidden email]>

> Can Anyone Help me?
> My problem is when i change DataMemory value >2G nodes cannot connect to
> cluster and i get this error from managment server:
>
> ndb_mgm>
> Node 3: Forced node shutdown completed. Occured during startphase 0. Caused
> by error 2327: 'Memory allocation failure, please decrease some
> configuration parameters(Configuration error). Permanent error, external
> action needed'.
>
>
> Help me.
>
> --
> View this message in context:
> http://mysql-cluster.1050023.n4.nabble.com/Problem-When-Set-DataMemory-in-MySQL-cluster-tp4020307p4031141.html
> Sent from the MySQL - Cluster mailing list archive at Nabble.com.
>
> --
> MySQL Cluster Mailing List
> For list archives: http://lists.mysql.com/cluster
> To unsubscribe:
> http://lists.mysql.com/cluster?unsub=wagnerbianchijr@...
>
>

[Ridd1ck]

View My config.ini.

[NDBD DEFAULT]
NoOfReplicas=2
DataMemory=1900M
IndexMemory=512M
LockPagesInMainMemory=1
MaxNoOfConcurrentOperations=100000
MaxNoOfConcurrentTransactions=16384
StringMemory=25
MaxNoOfTables=20320
MaxNoOfOrderedIndexes=10160
MaxNoOfUniqueHashIndexes=2540
MaxNoOfAttributes=121920
MaxNoOfTriggers=71120
FragmentLogFileSize=256M
InitFragmentLogFiles=SPARSE
NoOfFragmentLogFiles=300
RedoBuffer=64M
TimeBetweenLocalCheckpoints=6

[MYSQLD DEFAULT]

[NDB_MGMD DEFAULT]

[TCP DEFAULT]

# Section for the cluster management node
[NDB_MGMD]
# IP address of the management node (this system)
HostName=192.168.1.1

# Section for the storage nodes
[NDBD]
# IP address of the first storage node
HostName=192.168.1.10
DataDir=/var/lib/mysql-cluster

[NDBD]
# IP address of the second storage node
HostName=192.168.1.20
DataDir=/var/lib/mysql-cluster

# one [MYSQLD] per storage node
[MYSQLD]
HostName=192.168.1.10
[MYSQLD]
HostName=192.168.1.20

[Jason Brooke-3]

How much memory do your data nodes have?



On 11/11/2011 12:12, Ridd1ck wrote:

> View My config.ini.
>
> [NDBD DEFAULT]
> NoOfReplicas=2
> DataMemory=1900M
> IndexMemory=512M
> LockPagesInMainMemory=1
> MaxNoOfConcurrentOperations=100000
> MaxNoOfConcurrentTransactions=16384
> StringMemory=25
> MaxNoOfTables=20320
> MaxNoOfOrderedIndexes=10160
> MaxNoOfUniqueHashIndexes=2540
> MaxNoOfAttributes=121920
> MaxNoOfTriggers=71120
> FragmentLogFileSize=256M
> InitFragmentLogFiles=SPARSE
> NoOfFragmentLogFiles=300
> RedoBuffer=64M
> TimeBetweenLocalCheckpoints=6
>
> [MYSQLD DEFAULT]
>
> [NDB_MGMD DEFAULT]
>
> [TCP DEFAULT]
>
> # Section for the cluster management node
> [NDB_MGMD]
> # IP address of the management node (this system)
> HostName=192.168.1.1
>
> # Section for the storage nodes
> [NDBD]
> # IP address of the first storage node
> HostName=192.168.1.10
> DataDir=/var/lib/mysql-cluster
>
> [NDBD]
> # IP address of the second storage node
> HostName=192.168.1.20
> DataDir=/var/lib/mysql-cluster
>
> # one [MYSQLD] per storage node
> [MYSQLD]
> HostName=192.168.1.10
> [MYSQLD]
> HostName=192.168.1.20
>
> --
> View this message in context: http://mysql-cluster.1050023.n4.nabble.com/Problem-When-Set-DataMemory-in-MySQL-cluster-tp4020307p4031204.html
> Sent from the MySQL - Cluster mailing list archive at Nabble.com.
>

--
MySQL Cluster Mailing List
For list archives: http://lists.mysql.com/cluster
To unsubscribe:    http://lists.mysql.com/cluster?unsub=lists+1264099649148-1050023@...

[Ridd1ck]

I have 24 GB on each and i run fedora 15 64 bit.

[Jason Brooke-3]

are you using the 64bit cluster build?
do you have any security settings that might curb ram allocation?



On 11/11/2011 13:35, Ridd1ck wrote:
> I have 24 GB on each and i run fedora 15 64 bit.
>
> --
> View this message in context: http://mysql-cluster.1050023.n4.nabble.com/Problem-When-Set-DataMemory-in-MySQL-cluster-tp4020307p4031373.html
> Sent from the MySQL - Cluster mailing list archive at Nabble.com.
>

--
MySQL Cluster Mailing List
For list archives: http://lists.mysql.com/cluster
To unsubscribe:    http://lists.mysql.com/cluster?unsub=lists+1264099649148-1050023@...

[Ridd1ck]

I try with 32 bit ver, there is a limitation of ndbd process with memory allocate?

[Jason Brooke-3]

off the top of my head, I'd expect you might be able to use somewhere up
to around 3gb or so with the 32bit version, but if you have 24gb and you
want to be able to use it all you'll most likely want to run the 64bit
build

I don't know the details though, so check the documentation



On 11/11/2011 15:24, Ridd1ck wrote:
> I try with 32 bit ver, there is a limitation of ndbd process with memory
> allocate?
>
> --
> View this message in context: http://mysql-cluster.1050023.n4.nabble.com/Problem-When-Set-DataMemory-in-MySQL-cluster-tp4020307p4031640.html
> Sent from the MySQL - Cluster mailing list archive at Nabble.com.
>

--
MySQL Cluster Mailing List
For list archives: http://lists.mysql.com/cluster
To unsubscribe:    http://lists.mysql.com/cluster?unsub=lists+1264099649148-1050023@...

[Ridd1ck]

Thank you i will try with 64 bit ver

[Ridd1ck]

I was Installed the 64 bit version but when i try to increase datamemory i have the same problem!!!!!!!!
What can i do for this?
i Get this Error again and again, i'm really confused about this.

Node 2: Forced node shutdown completed. Occured during startphase 0. Caused by error 2327: 'Memory allocation failure, please decrease some configuration parameters(Configuration error). Permanent error, external action needed'.

[Johan Andersson-3]

Hi,

* Are you running as 'root'? If not - do you any limitations for the
user you are running as?
* what does 'free -m' say?
* What else do you have in your config.ini?

-j

On 2011-11-14 13.25, Ridd1ck wrote:

> I was Installed the 64 bit version but when i try to increase datamemory i
> have the same problem!!!!!!!!
> What can i do for this?
> i Get this Error again and again, i'm really confused about this.
>
> Node 2: Forced node shutdown completed. Occured during startphase 0. Caused
> by error 2327: 'Memory allocation failure, please decrease some
> configuration parameters(Configuration error). Permanent error, external
> action needed'.
>
>
> --
> View this message in context: http://mysql-cluster.1050023.n4.nabble.com/Problem-When-Set-DataMemory-in-MySQL-cluster-tp4020307p4039304.html
> Sent from the MySQL - Cluster mailing list archive at Nabble.com.
>

--
MySQL Cluster Mailing List
For list archives: http://lists.mysql.com/cluster
To unsubscribe:    http://lists.mysql.com/cluster?unsub=lists+1264099649148-1050023@...

[Ridd1ck]

config.ini
[NDBD DEFAULT]
NoOfReplicas=2
DataMemory=1900M
IndexMemory=512M
LockPagesInMainMemory=1
MaxNoOfConcurrentOperations=100000
MaxNoOfConcurrentTransactions=16384
StringMemory=25
MaxNoOfTables=20320
MaxNoOfOrderedIndexes=10160
MaxNoOfUniqueHashIndexes=2540
MaxNoOfAttributes=121920
MaxNoOfTriggers=71120
FragmentLogFileSize=256M
InitFragmentLogFiles=SPARSE
NoOfFragmentLogFiles=300
RedoBuffer=64M
TimeBetweenLocalCheckpoints=6

[MYSQLD DEFAULT]

[NDB_MGMD DEFAULT]

[TCP DEFAULT]

# Section for the cluster management node
[NDB_MGMD]
# IP address of the management node (this system)
HostName=192.168.1.1

# Section for the storage nodes
[NDBD]
# IP address of the first storage node
HostName=192.168.1.10
DataDir=/var/lib/mysql-cluster

[NDBD]
# IP address of the second storage node
HostName=192.168.1.20
DataDir=/var/lib/mysql-cluster

# one [MYSQLD] per storage node
[MYSQLD]
HostName=192.168.1.10
[MYSQLD]
HostName=192.168.1.20

i'm running as root and the limitations are the default also free-m command output is:
free -m:

             total       used       free     shared    buffers     cached
Mem:         24160       2378      21781          0        197       1542
-/+ buffers/cache:        638      23521
Swap:         8190          0       8190

[umapathi b]

I think you have given very less DataMemory and IndexMemory even though
you are having 20 Gigs of memory.

Try to keep those parameters ..as per your data requirements ..
Make sure the addition of these Datamemory and Indexmemory doesn't cross
the memory available / the importing data size of your db.
and start the cluster with --initial mode and see ..

- Umapathi.

On Mon, Nov 14, 2011 at 6:33 PM, Ridd1ck <[hidden email]> wrote:

> config.ini
> [NDBD DEFAULT]
> NoOfReplicas=2
> DataMemory=1900M
> IndexMemory=512M
> LockPagesInMainMemory=1
> MaxNoOfConcurrentOperations=100000
> MaxNoOfConcurrentTransactions=16384
> StringMemory=25
> MaxNoOfTables=20320
> MaxNoOfOrderedIndexes=10160
> MaxNoOfUniqueHashIndexes=2540
> MaxNoOfAttributes=121920
> MaxNoOfTriggers=71120
> FragmentLogFileSize=256M
> InitFragmentLogFiles=SPARSE
> NoOfFragmentLogFiles=300
> RedoBuffer=64M
> TimeBetweenLocalCheckpoints=6
>
> [MYSQLD DEFAULT]
>
> [NDB_MGMD DEFAULT]
>
> [TCP DEFAULT]
>
> # Section for the cluster management node
> [NDB_MGMD]
> # IP address of the management node (this system)
> HostName=192.168.1.1
>
> # Section for the storage nodes
> [NDBD]
> # IP address of the first storage node
> HostName=192.168.1.10
> DataDir=/var/lib/mysql-cluster
>
> [NDBD]
> # IP address of the second storage node
> HostName=192.168.1.20
> DataDir=/var/lib/mysql-cluster
>
> # one [MYSQLD] per storage node
> [MYSQLD]
> HostName=192.168.1.10
> [MYSQLD]
> HostName=192.168.1.20
>
> i'm running as root and the limitations are the default also free-m command
> output is:
> free -m:
>
>             total       used       free     shared    buffers     cached
> Mem:         24160       2378      21781          0        197       1542
> -/+ buffers/cache:        638      23521
> Swap:         8190          0       8190
>
>
>
>
> --
> View this message in context:
> http://mysql-cluster.1050023.n4.nabble.com/Problem-When-Set-DataMemory-in-MySQL-cluster-tp4020307p4039383.html
> Sent from the MySQL - Cluster mailing list archive at Nabble.com.
>
> --
> MySQL Cluster Mailing List
> For list archives: http://lists.mysql.com/cluster
> To unsubscribe:
> http://lists.mysql.com/cluster?unsub=umapathi.b@...
>
>

[Ridd1ck]

With this config my cluster start normally, my database is 16 Gb size.
My problem is when i try to set datamemory size> 1900M.
For example if i set the datamemory 2000M ndbd process cannot connect to cluster...

[Ridd1ck]

Is there a function that can calculate the memry usage that the machine is using,
because of my config.ini parameteres.
For example the MaxNoOfTables or UniqueHashIndex parameters have extra memory allocation when i try to start ndbd process?

[Ridd1ck]

after several hours and installiation of all cluster 3 times i figured out that ndbd process is 32 bit
But the package is x86_x64
this is terrible!
what cn i do to run and install ndbd 64 bit version.
the file that i use is:mysql-cluster-gpl-7.1.15a-linux-x86_64-glibc23.tar.gz

file /usr/bin/ndbd
/usr/bin/ndbd: ELF 32-bit LSB executable, Intel 80386, version 1 (SYSV), dynamically linked (uses shared libs), for GNU/Linux 2.2.5, not stripped


Please Help me guys, i need your support....