All About Databases

Sunday, June 7, 2009

Informatica : Setting codepage
Informatica integration service sometimes fails with the following error when trying to startup: LM_36011 Code page mismatch. Service process is running in code page [ISO 8859-1 Western European] whereas the service is configured in the Admin Console to run in code page [UTF-8 encoding of Unicode] Set the following environment variables on the server hosting Informatica nodes: setenv LANG en_US.utf8 setenv LC_ALL en_US.utf8 setenv INFA_CODEPAGENAME UTF-8 Re-start the node service. Now, integration service can be started with codepage set to UTF-8. Posted by Nitin Aggarwal at 11:16 PM 46 comments: Ping said... I encounter the same problem as you. a little difference from yours. Code page mismatch. Service process is running in code page [MS Windows Latin 1 (ANSI), superset of Latin1] whereas the service is configured in the Admin Console to run in code page [ISO 8859-1 Western European] How can I set the env variables in my case? hope I can get your help. June 16, 2009 11:23 PM Nitin Aggarwal said...

For ISO 8859-1 Western European codepage name would be "Latin1". Alternatively you can change the codepage for integration service to MS Windows Latin 1 (ANSI) under gid/node assignments in admin console. June 17, 2009 6:36 AM Ping said... Thank you very much for your reply. My problem originated from my changing the code page from [ISO 8859-1 Western European] to [MS Windows Latin 1 (ANSI), superset of Latin1] in admin console, and then changed back to [ISO 8859-1 Western European]. then the problem ocurred. I searched the admin console, I can't find more place which would have the code page info in it. And if try the way you provide, are you sure the codepage name for [ISO 8859-1 Western European] is "Latin1"? it might be the name of [MS Windows Latin 1 (ANSI), superset of Latin1]? or it should be "ISO..." or something. because my problem is not disappear.... Would please find more information for me? I really appreciate your time and patient. June 17, 2009 7:29 AM Ping said... Thanks, but it seems ISO 8859-1 Western European codepage name is not "Latin1". June 19, 2009 1:00 PM Nitin Aggarwal said... Ping, I had checked this codepage at informatica site my.informatica.com. You can register yourself there and confirm the same. June 26, 2009 10:27 AM Ping said... Nitin, you were right. It was because I made some mistake during the config. it works now.

Thank you a lot! Ping June 26, 2009 5:02 PM Eduardo said... Hi. I have the same problem as Ping the only diference is the other language Code page mismatch. Service process is running in code page [MS Windows Latin 1 (ANSI), superset of Latin1] whereas the service is configured in the Admin Console to run in code page [[id = -1]] I have to use MS Windows Latin 1 (ANSI), superset of Latin1 Can you please explain to me how can I fix it. Thanks a lot August 19, 2009 10:53 AM Anonymous said... thanks you solve my problem about Informatica. thanks a lot Alberto September 14, 2009 5:00 AM girish said... I have to read data from a flat file which contains both english language characters and chinese and some special foreign language characters, the chinese and foreign language characters are not getting displayed properly after loading the data in staging table, can you please tell if i need to do some special setting. November 16, 2009 1:19 AM Nitin Aggarwal said... @girish I hope you are using Unicode codepage to load all your data. Which also means that you are creating tables with datatype percision specified as "CHAR" i.e.

create table test ( a varchar2(10 CHAR)) This will ensure all unicode data lands as is in your warehouse tables. From what you said, it appears that the problem lies with your client >> language characters are not getting displayed properly after loading the data in staging table So, data may be there but may not be handled well by your client application. November 16, 2009 7:55 PM Paresh said... Hi Nitin, I'm facing a similar issue, the Integration Service won't start keeps failing with the following error. LM_36011 Code page mismatch. Service process is running in code page [MS Windows Latin 1 (ANSI), superset of Latin1] whereas the service is configured in the Admin Console to run in code page [UTF-8 encoding of Unicode] I've gone through your blog and set the environment variables but still the same error. Am i missing anything? Any help is much appreciated. PowerCenter8.6.1 on Windows December 4, 2009 6:52 AM Nitin Aggarwal said... @Paresh Can you check what is the codepage setting for your integration service and repository service. To set codepage for integration service just edit its properties and specify codepage as UTF-8. If repository service is created using codepage other than UTF-8, then you have to drop and re-create it with the correct codepage. hope this helps. December 4, 2009 7:19 PM Paresh said...

Hi Nitin, Pls see answers to your questions below. Repo Service Codepage = UTF-8 encoding of Unicode Integration Service = UTF-8 encoding of Unicode (But the service doesn't start with this setting) Since the Repository & Integration service is configured to with UTF8 codepage don't see what exactly is the cause of the issue. Thanks for all your help. December 7, 2009 9:01 AM Nitin Aggarwal said... @Parekh Try setting windows environment variables LC_ALL and LANG to us_UTF8 and then start the service. December 7, 2009 9:31 PM Paresh said... Nitin, That seems to have done the trick. For the benefit of myself (and others) would you be able to breifly explain the difference between setting these values to us_UTF8 as opposed to en_US.UTF8. Thanks a ton. Rgds Paresh December 8, 2009 8:11 AM Nitin Aggarwal said... This post has been removed by the author. December 8, 2009 10:29 PM Nitin Aggarwal said...

@Paresh Glad it worked!! These are the values which needs to be set for Windows and Linux OS respectively. en_US.UTF8 is for Linux whereas us_UTF8 is for Windows. December 8, 2009 10:31 PM Nitin Aggarwal said... @Paresh Glad it worked!! These are the values which needs to be set for Windows and Linux OS respectively. en_US.UTF8 is for Linux whereas us_UTF8 is for Windows. December 8, 2009 10:31 PM suresh said... Hi Nitin, I am having the problem starting the integration services. i followed the steps you mentioned but still i am getting the following error LM_36011 Code page mismatch. Service process is running in code page [MS Windows Latin 1 (ANSI), superset of Latin1] whereas the service is configured in the Admin Console to run in code page [UTF-8 encoding of Unicode] i have set the environmental variables also but no use. I am using windows vista home premium. Please help. Thank you, Suresh December 16, 2009 11:05 AM Nitin Aggarwal said... I believe you have same problem as Paresh had (see the comments above). Try setting windows environment variables LC_ALL and LANG to us_UTF8 and then start the service.

December 16, 2009 11:03 PM gurpartap said... how can i create these env variables in windows vista December 20, 2009 12:37 PM Nitin Aggarwal said... I'm not sure about vista but this is how i do in XP (Should be same in Vista too, I think). Right click "My Computer" icon Select Properties Go to Advanced Tab Click Environment Variables Add two system variables and their values as I mentioned above. December 20, 2009 7:36 PM gurpartap said... I have created two variables as variable name variable value LC_ALL LC_ALL LANG us_UTF8 After that I have restarted the computer and tried to restart the integration service with utf8 but still get the same error. Can you please tell me what did I do wrong now? Thanks Nitin December 20, 2009 8:49 PM Nitin Aggarwal said... Variable value for LC_ALL should be us_UTF8 ( you seem to have set it to LC_ALL). Can you also post the exact error you are getting ? December 20, 2009 8:59 PM gurpartap said...

the service manager could not start the service due to the following error: [PCSF_10342] Exception occured [Unable to start service [prod_int] on any node specified for the service. Code page mismatch. Service process is running in code page [MS Windows Latin 1 (ANSI), superset of Latin1] whereas the service is configured in the Admin Console to run in code page [UTF-8 encoding of Unicode]. I am getting the above error. December 20, 2009 9:25 PM gurpartap said... I have changed the LC_ALL value to us_UTF8 but still get the error as Code page mismatch. Service process is running in code page [MS Windows Latin 1 (ANSI), superset of Latin1] whereas the service is configured in the Admin Console to run in code page [UTF-8 encoding of Unicode] December 20, 2009 9:41 PM Artur said... Setting INFA_CODEPAGENAME=UTF-8 environemnt variable worked for me. It seems that LC_ALL and LANG vars do not matter. I had error Code page mismatch. Service process is running in code page [MS Windows Latin 1 (ANSI), superset of Latin1] whereas the service is configured in the Admin Console to run in code page [UTF-8 encoding of Unicode] My config: PowerCenter 8.6.1 64-bit on Windows 7 64-bit. Thanks, Artur January 5, 2010 4:04 PM Anonymous said... Hi Nitin,

your suggestion did work for me. I have added the 3 environment variables and the service came up and running. Thanks a lot. Sunil February 22, 2010 6:04 AM Prathamesh said... Hi..thanks for a great post..i am hing issue with special characters getting lost. I am working on the client environment and hence have to point out to them what the problem is Source and target tables are in same database whose code set page is UTF-8. Session log shows the Server Mode as Unicode. Whereas the Server Code Page is [MS Windows Latin 1 (ANSI), superset of Latin1]. Is the server code page causing this issue? The April 16, 2010 9:23 AM Nitin Aggarwal said... Hi Prathamesh, You seem to be running your integration service in Windows Latin codepage. Try to run your infa server (by setting the required env variables) as well as services in UTF-8 codepage and check if it helps. April 20, 2010 12:11 AM Mario said... Im using Windows 2000, and the solution worked as well, the only consideration is that you need to restart the machine once you declare the global variables. Thank you for the solution April 24, 2010 6:21 PM Mario said...

Ihad the same issue "Service process is running in code page [MS Windows Latin 1 (ANSI), superset of Latin1] whereas the service is configured in the Admin Console to run in code page [UTF-8 encoding of Unicode]" on a Windows 2000, Nitin, your solution worked in W2K also. The only consideration is that you need to restart the computer once you declare the global variables. Thank You April 24, 2010 6:26 PM Nitin Aggarwal said... Hi Mario, I have not tried these settings on Win2K. Somehow I believe there should not be any need to reboot the machine. But, as I said, I have not tried, I take your words. April 25, 2010 9:18 PM PooJa said... Hi Nitin, Thanks a lot. I was banging my head before coming to your blog. Keep up the good work. May 13, 2010 11:27 AM Anonymous said... I have a requirement to load data from flat files(english,Chinese,Japanese,and Korean (CJK) fonts) to DB(Oracle/DB2). We are looking at ETLInformatica/Java Code options. We need to automate the complete Process. (Files comes in MOnthly basis) 1]Need to download file from HTTPS site(Zip/DAT file) or lookup in Shared Location. 2]UnZIP and get the flat files 3]Do Transformation/Mapping on Flat file(around 15 files). 4]Load data to DB (Biggest file is of 1GB) 5]Generate flat file and put in Shared Drive and sent automated mail to the concerned team. 6]Firstly we need to do a Data migration from Current DB to the new Data Model.

Does ETL tool can support all the above.(Mainly Step 1,2,5 and 6) If it can you please provide the options to achieve this.(Using Tools / API Support for Java). Thanks in advance. Roshan June 20, 2010 10:49 PM Antonio said... I am having the LM_36011 msg... Infa server is running under windows and oracle db running under Linux. Msg says that service is running with MS-Latin and Admin console in Western 8859. I know that db is running with Western so Rep.Service was created using Western 8859 - that was the only way it works. Integration service fails with LM_36011. Pls. is it possible to change the environment variables in windows too ? Thru the Control Panel > System ? June 22, 2010 11:18 AM Dr said... hey I have windows Xp and Oracle 11g Installed. I have installed Informatica 8.6 but when I am trying to create a repository I am getting "The Repository Service was created, but the service could not be enabled. You must enable the service to create the content. The following error occurred while attempting to create the content. Error - [PCSF_10342] Exception occurred: [Unable to start service [INFADevRepository] on any node specified for the service.]. " Any Help Will be appreciated. June 29, 2010 2:19 AM Anonymous said... I have the exact same error as Eduardo, where my existing integration service code page is shown as -1. What do I do? I am using WINDOWS SERVER. July 7, 2010 2:36 PM Nitin Aggarwal said...

@Anonymous This is what I found in my.informatica.com: To resolve the issue, do the following: 1. In the Administration Console, select the Integration Service. 2. Select the Process tab. 3. Select the row of the node on which the Integration Service should be enabled (Do not select the node link). The Service Process Properties will appear. 4. In the Service Process Properties, go to the General Properties and click Edit. 5. Select a Codepage for the Integration Service and click OK. The Integration Service code page must match the node (operating system environment) code page. 6. Enable the Integration Service. July 10, 2010 8:32 AM Anonymous said... If the database in which the IPC repository and domain reside, changes character set to AL32UTF8, do I need to update the IPC data movement mode and code pages also for the repository and integration service? They are currently set to MS Windows Latin 1 (ANSI) and data movement mode is ASCII. August 24, 2010 2:19 PM Nitin Aggarwal said... @anonymous I think just changing the data movement mode should be enough. Code page settings for repository and integration service does not have much to do with data

movement except for being able to read the informatica repository metadata correctly. August 31, 2010 10:38 PM Anonymous said... Hi Nitin, I have tried creating the repository service but ended with the error 'pcsf_10342:Unable to start service on any of the node specified for the service'. The database code page is WE8ISO8859P1 and the repository level code page that i have set is ISO 8859 - 1 Western European. Please provide me some insight into this problem. Regards, Aparna September 6, 2010 5:25 AM Anonymous said... Hello Nitin, I'm one of the persons to have learnt much from your blog. Keep it up. I was facing an issue where in records having data other than english were not loaded into the warehousee. What, do you think, could be the reason? The repo svc and intg svc code page are set to 'MS Windows Latin 1 (ANSI), superset of Latin1' September 22, 2010 1:55 PM Chinnu said... Im trying to load non-Ascii characters in my target table, but they are not loading properly. I have declared it as nvarchar..But still Im having the same error. The code page is MS Windows Latin.. Please help September 29, 2010 1:16 PM Archana said...

Hi..can you please let me know if this works for Informatica 7 October 1, 2010 12:58 AM Nitin Aggarwal said... @Anonymous: I do not think this error "pcsf_10342:Unable to start service on any of the node specified for the service" has anything to do with codepage. Looks like some configuration issue. @Anonymous: Try unicode character set e.g. UTF-8 @Chinnu: did you try with UTF-8 code page ? @Archana: not sure. October 6, 2010 11:54 PM Post a Comment Newer Post Older Post Home Subscribe to: Post Comments (Atom)

About Me

Nitin Aggarwal I work extensively on BI and Data warehousing technologies. Database tuning while managing ETL flows over huge volume databases is one of my strong points. In this blog i try to put together various ideas that worked for me while trying to crack the tough nuts. View my complete profile

Blog Archive

2010 (5) o October (1) Intra-Block versus Inter-Block row chaining o May (1) BI Apps ETL: Handling statistics gathering over ta...

o o

March (1) Linux : Scanning for an occurance of string in all... January (2) Upgrading AIX system to next Technology Level DAC: no db2jdbc in java.library.path

2009 (14) o December (1) Oracle : Values of Hidden init parameters o November (3) Configure DBD::ODBC on AIX 5.3 CPAN : reset proxy settings setting root prompt with sudo access o October (1) Removing Oracle 11gR2 software o June (1) Informatica : Setting codepage o April (5) Oracle : Using WITH Clause for improving performan... DB2 : collecting detailed statistics DB2 : Generating SQL Explain plan INFORMATICA : Truncate Logs DB2 : Establish remote connection on Unix/AIX o February (1) Oracle :Outer Join pitfalls o January (2) Informatica 8.6 : issue with pmcmd Oracle: Correlated sub-queries effectiveness 2008 (7) o August (2) Oracle : Resolving ORA-29275: partial multibyte ch... Oracle : storing strings in multibyte character fo... o July (1) Oracle : Finding Non-numeric column record in a ta... o April (1) Oracle: Deleting duplicates from a huge table o March (1) Oracle : ORA-4030 in AIX Environment o January (2) Oracle: HASH JOIN RIGHT OUTER Informatica : Lookups Versus Outer Joins 2007 (17) o December (1) Oracle: hash_area_size and sort_area_size

o o

November (1) Solaris : Troubleshooting Memory & CPU Consumption... October (5) PERL : diff two files Remove ^M from files transferred from Windows to L... Oracle ODBC : Driver's SQLAllocHandle on SQL_HANDL... Oracle: Spooling Column of type Long Oracle : Support for Very Large Memory (VLM) Confi... September (3) Reset OC4J Admin Password ORA-27047: unable to read the header block of file... Oracle BITMAP Index Structure August (7) MSSQL : Collation - a way out of case-insensitiven... MSSQL : Deleting duplicate rows DAC/Informatica src files connection AWE and /3GB Switch for Windows Informatica shared memory MS SQL Server is too case sensitive Restore MSSQL DB from mdf,ldf and ndf files