데이터베이스를 사랑하는 사람들의 모임 데이터베이스 사랑넷

LDAP Q&A 2393 게시물 읽기

No. 2393

Sizelimit exceeded에러 해결 방법
작성자	강민우(lycosno)	작성일	2008-08-22 15:31	조회수	6,812

# /opt/IBM/ldap/V6.1/bin/idsldapmodify -t -D cn= -w -f /script/apl/tmp/ldap/TEST2.ldif
starting transaction
ldap_start_transaction returned Success.

Operation 0 modifying entry uid=MXG0007619,ou=users,ou=SWG,o=IBM,c=US
Operation 1 modifying entry uid=MXG0009808,ou=users,ou=SWG,o=IBM,c=US
Operation 2 modifying entry uid=MXG0007618,ou=users,ou=SWG,o=IBM,c=US
Operation 3 modifying entry uid=MXG0007617,ou=users,ou=SWG,o=IBM,c=US
Operation 4 modifying entry uid=MXG0007616,ou=users,ou=SWG,o=IBM,c=US
Operation 5 modifying entry uid=MXG0007615,ou=users,ou=SWG,o=IBM,c=US
preparing transaction
ldap_prepare_transaction returned: Protocol error.

ldap_transaction_operation: 0 Sizelimit exceeded
ldap_transaction_operation: 0: additional info: Rollback transaction

이상으로 ldap서버에 유저의 정보를 갱신을 하는 중 트랜잭션을 걸었는데

트랜잭션 사이즈 문제로 에러가 발생 하였습니다.

콘피그 파일도 변경하고 서버를 재기동 했는데도 이 에러가 해결이 안되는데

해결 방법 좀 부탁드립니다.

이 글에 대한 댓글이 총 7건 있습니다.

IBM Tivoli Directory를 쓰시고 계시네요.

일단 저에게 메일로 ibmslapd.conf파일을 보내주시면 확인 해보겠습니다.

요즘 안들어와 보니 질문이 올라와 있는것도 보지 못했네요.

그럼 수고하세요.

송상준(sjsong)님이 2008-08-29 18:09에 작성한 댓글입니다.

dn: cn=Transaction, cn=Configuration
cn: Transaction
ibm-slapdMaxNumOfTransactions: 200
ibm-slapdMaxOpPerTransaction: 100
ibm-slapdMaxTimeBetweenPrepareAndCommit: 2
ibm-slapdMaxTimeLimitOfTransactions: 300
ibm-slapdTransactionEnable: TRUE
objectclass: top
objectclass: ibm-slapdConfigEntry
objectclass: ibm-slapdTransaction

이 부분을 잘 설정하시고요 테스트 해보니 잘되네요

starting transaction
ldap_start_transaction returned Success.

Operation 0 modifying entry o=sample
Operation 1 modifying entry ou=Austin, o=sample
Operation 2 modifying entry ou=In Flight Systems, ou=Austin, o=sample
Operation 3 modifying entry ou=Home Entertainment, ou=Austin, o=sample
Operation 4 modifying entry ou=Groups, o=sample
Operation 5 modifying entry cn=Bowling team, ou=Groups, o=sample
Operation 6 modifying entry ou=Widget Division, ou=Austin, o=sample
Operation 7 modifying entry cn=Mary Burnnet, ou=Widget Division, ou=Austin, o=sa
mple
Operation 8 modifying entry cn=David Campbell, ou=Widget Division, ou=Austin, o=
sample
Operation 9 modifying entry cn=James Campbell, ou=Widget Division, ou=Austin, o=
sample
Operation 10 modifying entry cn=Michael Campbell, ou=Widget Division, ou=Austin,
o=sample
Operation 11 modifying entry cn=Michael Campbell+postalcode=4609, ou=Widget Divi
sion, ou=Austin, o=sample
Operation 12 modifying entry cn=Bob Campbell, ou=In Flight Systems, ou=Austin, o
=sample
Operation 13 modifying entry cn=Bonnie Daniel, ou=Widget Division, ou=Austin, o=
sample
Operation 14 modifying entry cn=Brenda England, ou=Widget Division, ou=Austin, o
=sample
Operation 15 modifying entry cn=David Delbert, ou=Widget Division, ou=Austin, o=
sample
Operation 16 modifying entry cn=Al Edwards, ou=Widget Division, ou=Austin, o=sam
ple
Operation 17 modifying entry cn=Arthur Edwards, ou=Widget Division, ou=Austin, o
=sample
Operation 18 modifying entry cn=Curtis Edwards Jr, ou=Widget Division, ou=Austin
, o=sample
Operation 19 modifying entry cn=Cynthia Flowers, ou=Home Entertainment, ou=Austi
n, o=sample
Operation 20 modifying entry cn=Doug Edwards, ou=Home Entertainment, ou=Austin,
o=sample
Operation 21 modifying entry cn=Jeffrey James, ou=Home Entertainment, ou=Austin,
o=sample
Operation 22 modifying entry cn=Ron Edwards, ou=Home Entertainment, ou=Austin, o
=sample
Operation 23 modifying entry cn=Jerry Chevy, ou=Home Entertainment, ou=Austin, o
=sample
Operation 24 modifying entry cn=Marvin McGee, ou=Home Entertainment, ou=Austin,
o=sample
Operation 25 modifying entry cn=Marshall Riely, ou=Home Entertainment, ou=Austin
, o=sample
Operation 26 modifying entry cn=James Giliam, ou=Home Entertainment, ou=Austin,
o=sample
Operation 27 modifying entry cn=Al Garcia, ou=Home Entertainment, ou=Austin, o=s
ample
Operation 28 modifying entry cn=Ben Garcia Jr, ou=Home Entertainment, ou=Austin,
o=sample
Operation 29 modifying entry cn=Becky Garcia, ou=In Flight Systems, ou=Austin, o
=sample
Operation 30 modifying entry cn=Maria Garcia, ou=In Flight Systems, ou=Austin, o
=sample
Operation 31 modifying entry cn=Bob Garcia, ou=Austin, o=sample
Operation 32 modifying entry cn=Ricardo Garcia, ou=Austin, o=sample
Operation 33 modifying entry cn=Amy Nguyen, ou=In Flight Systems, ou=Austin, o=s
ample
Operation 34 modifying entry cn=James Nguyen, ou=In Flight Systems, ou=Austin, o
=sample
Operation 35 modifying entry cn=Henry Nguyen, ou=Austin, o=sample
Operation 36 modifying entry cn=Kyle Nguyen, ou=Austin, o=sample
Operation 37 modifying entry cn=Wayne Nguyen, ou=Austin, o=sample
Operation 38 modifying entry cn=Jason Li, ou=In Flight Systems, ou=Austin, o=sam
ple
Operation 39 modifying entry cn=Melinda Charles, ou=In Flight Systems, ou=Austin
, o=sample
Operation 40 modifying entry cn=Bill Keller Jr., ou=In Flight Systems, ou=Austin
, o=sample
Operation 41 modifying entry cn=Cynthia Smith, ou=In Flight Systems, ou=Austin,
o=sample
Operation 42 modifying entry cn=Donald Sinclar, ou=In Flight Systems, ou=Austin,
o=sample
Operation 43 modifying entry cn=Ben Catu, ou=In Flight Systems, ou=Austin, o=sam
ple
Operation 44 modifying entry cn=Eddie Catu, ou=In Flight Systems, ou=Austin, o=s
ample
Operation 45 modifying entry cn=Jesse Catu, ou=In Flight Systems, ou=Austin, o=s
ample
Operation 46 modifying entry cn=Joe Simms, ou=In Flight Systems, ou=Austin, o=sa
mple
Operation 47 modifying entry cn=Judy Simms, ou=In Flight Systems, ou=Austin, o=s
ample
Operation 48 modifying entry cn=Linda Carlesberg, ou=Austin, o=sample
Operation 49 modifying entry cn=Robert Dean, ou=In Flight Systems, ou=Austin, o=
sample

preparing transaction
ldap_prepare_transaction returned: Success
ending transaction: requesting commit.
ldap_end_transaction returned Success.

송상준(sjsong)님이 2008-08-29 19:05에 작성한 댓글입니다.

네 답변감사합니다

ㅜ.ㅜ 현장관계자한테 물어보니...결국 트랜잭션의 최대값이 500밖에 안된다는 ㅜ.ㅜ

그런데 관련자료에는 1억건이상 된다고 해서 20만건으로 트랜잭션을 자꾸 걸으려 하니 에러가 났었답니다 답변은 정말 감사했습니다.

강민우님이 2008-09-24 16:05에 작성한 댓글입니다. Edit Ｘ

테스트이신가요? 아님 Real하게 그렇게 쓰시는건가요?

어디에서 그렇게 쓰시는건가요? 메일로 저의 전화와 메일 주소 보내드렸습니다.

1억건이면 엄청 많은건데요. 이걸 LDAP에 넣을 생각이시면 다른 방법으로 넣으셔야 될거
같은데요.

송상준(sjsong)님이 2008-09-24 16:31에 작성한 댓글입니다.

Enabling transaction support To enable transaction support use one of the following procedures. Using Web Administration: If you have not done so already, click Server administration in the Web Administration navigation area and then click Manage server properties in the expanded list. Next, click the Transactions tab. 1. Select the Enable transaction processing check box to enable transaction processing. If Enable transaction processing is disabled, all other options on this panel, such as Maximum number of operations per transaction and Pending time limit, are ignored by the server. 2. Set the Maximum number of transactions. Click either the Transactions or the Unlimited radio button. If you select Transactions, you need to specify in the field the maximum number of transactions. The maximum number of transactions is 2,147,483,647. The default setting is 20 transactions. 3. Set the Maximum number of operations per transaction. Click either the Operations or the Unlimited radio button. If you select Operations, you need to specify in the field the maximum number of operations allowed for each transaction. The maximum number of operations is 2,147,483,647. The smaller the number, the better the performance. The default is 5 operations. 4. Set the Pending time limit. This selection sets the maximum timeout value of a pending transaction in seconds. Click either the Seconds or the Unlimited radio button. If you select Seconds, you need to specify in the field the maximum number of seconds allowed for each transaction. The maximum number of seconds is 2,147,483,647. Transactions left uncompleted for longer than this time are cancelled (rolled back). The default is 300 seconds. 5. When you are finished, click Apply to save your changes without exiting, or click OK to apply your changes and exit, or click Cancel to exit this panel without making any changes.

The maximum number of transactions is 2,147,483,647

이라고 나와있는데요.

송상준(sjsong)님이 2008-09-24 16:49에 작성한 댓글입니다.

네 21억건이라고 나와 있었는데

지금 현장이 ibm관련 쪽에서 실제 업무 처리입니다..

은행 전산망 유져등록등의 일인데요

유져가이드에 21억건 된다고 적혀 있었는데 실무자에게 확인 결과

구현할려다 못했다고...500건 밖에 안된다고 하네요

실제 약 4만건 정도를 업데이트 또는 신규로 LDAP에 등록해야 하는데

500건 밖에 트랜잭션이 안걸릴경우 어떻게 해야할지 난감합니다....

LDAP는 처음 맡는 일인데요...담당자가 되어 버려서....조언 부탁드립니다.

실제 데이터는 4만건에서 7만건을 한번에 LDIF파일로 작성후 등록을 해야하는데

트랜잭션은 500건 밖에 소화를 못 할경우 어떻게 하면 해결이 되는지요 ㅜ.ㅜ

강민우님이 2008-09-29 10:40에 작성한 댓글입니다. Edit Ｘ

데이터 형태가 어떻게 되어 있는지 모르겠습니다.

저가 만약에 이 작업을 한다면 음

기존 데이터를 ldif로 export한후에 새로 추가될 데이터를 ldif로 만들어서 import를 하는데

bulkload를 하면 굳이 트랜잭션을 사용하지 않으셔도 될 듯합니다.

제가 Speedmate 작업시 100만건 update가 20분정도 걸렸습니다.

그럼 수고하세요.

송상준(sjsong)님이 2008-09-29 19:44에 작성한 댓글입니다.

[Top]

No.	제목	작성자	작성일	조회
2396	LDAP add 할때 우왕~!!! [1]	장진오	2008-10-02	6769
2395	LDAP을 이용한 SSO구축 특히 SSH 접속 인증방법? [2]	김동현	2008-09-03	8389
2394	ldap서버를 클라이언트에서 접속시 공개할 범위설정 [2]	초보킹	2008-09-01	6848
2393	Sizelimit exceeded에러 해결 방법 [7]	강민우	2008-08-22	6812
2388	open ldap 질문입니다. 도와주세요. [1]	초보	2008-05-30	6952
2387	윈도우에서 LDAP설치시 기본 필요사항들... [1]	급급급...ㅜㅜ;	2008-04-16	12802
2385	누구 ldap server 상용 프로그램 아시는분 추천요!! [3]	이용호	2008-03-19	7578