Cube, Build, Deploy, Process

Dear all,

I'd like to get simple and clear explanation of the cube in data mining, and 3 notions we encounter a lot : Build, Deploy, and Process.

(1) What is the cube that is created when we deploy a mining solution/project?
I wonder what type of cubes they are because although the dialog on deploy/process
show that cube, after successful deployment we still don't see the cube in Cubes folder
of the project.

(2) Why the SQL Server created that cube? Even though we process only one table
and only use case-table (without nested table)

(3) Can someone explain these 3 concepts with CLEAR differences between them?
(A) Build
(B) Deploy
(C) Process

As far as I know, the stages are like that : build, then deploy, then process. Also, it seems
to me that those operations do not create objects inside 'Relational' database, but create
objects (binary and text, with text files usually in XMLA programming language) in the
related project's folders and subfolders. Any good explanation is appreciated.

Bernaridho

1 & 2: The cube is an internal object used as a data structures in processing the mining structure and models. It is not visible externally and should be ignored. The only reason the cube is visible during processing is to surface potential processing errors, such as type mismatches.

3: Build - build takes the project's objects and builds a script that can be sent to the Analysis Services server. As with any "build" process, validation occurs to verify if any ovbious errors are present in the project

Deploy - Deploy sends the project to a server and creates any objects in that project on the server. Since the unit of deploymet is a database, any same-named database will be overwritten.

Process: Process is when the objects actually consume data and become useful. Prior to processing, the objects are "empty" and con not be queired.

|||Hi Jamie,

Thank you for replying. I'd like to add something about 'Process' that I found in your
book 'Data Mining with SQL Server 2005'. In the context of Data Mining, Process
also means 'Train'. That is, it's during 'Process' that the Analysis Service (background
process) trains the mining model. Hopefully this is useful for other member of this forum.

Thank you,

Bernaridho

Cube, Build, Deploy, Process

Dear all,

I'd like to get simple and clear explanation of the cube in data mining, and 3 notions we encounter a lot : Build, Deploy, and Process.

(1) What is the cube that is created when we deploy a mining solution/project?
I wonder what type of cubes they are because although the dialog on deploy/process
show that cube, after successful deployment we still don't see the cube in Cubes folder
of the project.

(2) Why the SQL Server created that cube? Even though we process only one table
and only use case-table (without nested table)

(3) Can someone explain these 3 concepts with CLEAR differences between them?
(A) Build
(B) Deploy
(C) Process

As far as I know, the stages are like that : build, then deploy, then process. Also, it seems
to me that those operations do not create objects inside 'Relational' database, but create
objects (binary and text, with text files usually in XMLA programming language) in the
related project's folders and subfolders. Any good explanation is appreciated.

Bernaridho

1 & 2: The cube is an internal object used as a data structures in processing the mining structure and models. It is not visible externally and should be ignored. The only reason the cube is visible during processing is to surface potential processing errors, such as type mismatches.

3: Build - build takes the project's objects and builds a script that can be sent to the Analysis Services server. As with any "build" process, validation occurs to verify if any ovbious errors are present in the project

Deploy - Deploy sends the project to a server and creates any objects in that project on the server. Since the unit of deploymet is a database, any same-named database will be overwritten.

Process: Process is when the objects actually consume data and become useful. Prior to processing, the objects are "empty" and con not be queired.

|||Hi Jamie,

Thank you for replying. I'd like to add something about 'Process' that I found in your
book 'Data Mining with SQL Server 2005'. In the context of Data Mining, Process
also means 'Train'. That is, it's during 'Process' that the Analysis Service (background
process) trains the mining model. Hopefully this is useful for other member of this forum.

Thank you,

Bernaridho

Cube deployment

Hi,

I am trying to silently deploy a cube within my install using the following command line:

"C:\Program Files\Microsoft SQL Server\90\Tools\Binn\VSShell\Common7\IDE\Microsoft.AnalysisServices.Deployment.exe" "c:\MyCubesFolder\Cubes.asdatabase" /s

but i keep getting the error message:

Reading input files...

Done

The 'Name' property cannot contain any of the following characters: . , ; ' ` : / * | ? " & % $ ! + = ( ) [ ] { } < >

The file contains URLs in some name properties with the ':' character. I tried removing those URLs but that didnt help.

Also, I was able to deploy the cube successfully using the same file from the Microsoft.AnalysisServices.Deployment.exe IDE - so I know my file is ok.

But I want to wrap this into the install and deploy it silently. Any ideas?

Thanks

Are you doing all steps from the list below ?

To create a XMLA script from solution project you have to buld solution (generas .asdatabase file), then run deployment wizard with option specifying that you want to generate XMLA script. Step by step guide:

Run script to build solution:
devenv.exe YourSolution.sln /build development /out BuildOutputLog.log
Instead of /build you can specify /rebuild
Instead of development you can specify other soluction configuration, like: Release
Example: "c:\Program Files\Microsoft Visual Studio 8\Common7\ide\devenv.exe" "c:\documents and settings\vidas\my documents\visual studio 2005\projects\MySolution\MySolution.sln" /build development /out BuildOutputLog.log Optionally run deployment wizard in answer mode to generate deployment script configuration. This is interactive step and can be done just once. Command:
Microsoft.AnalysisServices.Deployment.exe MySolution.asdatabase /a
Here /a runs deployment wizard in answer mode.
Example: Microsoft.AnalysisServices.Deployment.exe "c:\documents and settings\Vidas\My Documents\Visual Studio 2005\Projects\MySolution\MySolution\bin\MySolution.asdatabase" /a Run deployment wizard command line script to generate XMLA file:
Microsoft.AnalysisServices.Deployment.exe MySolution.asDatabase /d /o:c:\MySolutionXMLAScript.xmla
Example: Microsoft.analysisServices.Deployment.exe "c:\Documents And Settings\Vidas\My Documents\Visual Studio 2005\Projects\MySolution\MySolution\bin\MySolution.asDatabase" /d /o:c:\MySolutionXMLAScript.xmla|||

I think most of those names will refer to internal SSAS objects like annotations, so that is not likely to be the issue, specially if you can deploy from the UI. The ouput from silently deploying Adventure Works on my laptop look like the following. Notice that the line where you are getting hte error is where it should be attempting to connect to the target server. This is probably where the illegal character is. This should be in your .deploymentOptions file and it would depend on which configuration you had build last.

C:\Program Files\Microsoft SQL Server\90\Tools\Binn\VSShell\Common7\IDE>microsoft.analysisservices.deployment.exe "C:\Data\Projects\SSAS 2005 Samples\Enterprise\bin\Adventure Works DW.asdatabase" /s

Reading input files...
Done
Connecting to the localhost\sql05 server
Database, Adventure Works DW, found on server, localhost\sql05. Applying configuration settings and options...
Analyzing configuration settings...
Done
Analyzing optimization settings...
Done
Analyzing storage information...
Done
Analyzing security information...
Done
Generating processing sequence...
Deploying the 'Adventure Works DW' database to 'localhost\sql05'.
Done

Hope this helps

|||

Thanks for the replies

During install, I am updating the .deploymentOptions file with the ip address and instance where of the Analysis server where the cube is to be deployed. When I replaced the ip address with the system name, it seemed to work fine - looks like it cannot deal with the "." in the ip address - defect?

|||I think it might be. You should log this at http://connect.microsoft.com, it sounds like it might be an issue with the deployment wizard.

Cube deployment

Hi,

I am trying to silently deploy a cube within my install using the following command line:

"C:\Program Files\Microsoft SQL Server\90\Tools\Binn\VSShell\Common7\IDE\Microsoft.AnalysisServices.Deployment.exe" "c:\MyCubesFolder\Cubes.asdatabase" /s

but i keep getting the error message:

Reading input files...

Done

The 'Name' property cannot contain any of the following characters: . , ; ' ` : / * | ? " & % $ ! + = ( ) [ ] { } < >

The file contains URLs in some name properties with the ':' character. I tried removing those URLs but that didnt help.

Also, I was able to deploy the cube successfully using the same file from the Microsoft.AnalysisServices.Deployment.exe IDE - so I know my file is ok.

But I want to wrap this into the install and deploy it silently. Any ideas?

Thanks

Are you doing all steps from the list below ?

To create a XMLA script from solution project you have to buld solution (generas .asdatabase file), then run deployment wizard with option specifying that you want to generate XMLA script. Step by step guide:

Run script to build solution:
devenv.exe YourSolution.sln /build development /out BuildOutputLog.log
Instead of /build you can specify /rebuild
Instead of development you can specify other soluction configuration, like: Release
Example: "c:\Program Files\Microsoft Visual Studio 8\Common7\ide\devenv.exe" "c:\documents and settings\vidas\my documents\visual studio 2005\projects\MySolution\MySolution.sln" /build development /out BuildOutputLog.log Optionally run deployment wizard in answer mode to generate deployment script configuration. This is interactive step and can be done just once. Command:
Microsoft.AnalysisServices.Deployment.exe MySolution.asdatabase /a
Here /a runs deployment wizard in answer mode.
Example: Microsoft.AnalysisServices.Deployment.exe "c:\documents and settings\Vidas\My Documents\Visual Studio 2005\Projects\MySolution\MySolution\bin\MySolution.asdatabase" /a Run deployment wizard command line script to generate XMLA file:
Microsoft.AnalysisServices.Deployment.exe MySolution.asDatabase /d /o:c:\MySolutionXMLAScript.xmla
Example: Microsoft.analysisServices.Deployment.exe "c:\Documents And Settings\Vidas\My Documents\Visual Studio 2005\Projects\MySolution\MySolution\bin\MySolution.asDatabase" /d /o:c:\MySolutionXMLAScript.xmla|||

I think most of those names will refer to internal SSAS objects like annotations, so that is not likely to be the issue, specially if you can deploy from the UI. The ouput from silently deploying Adventure Works on my laptop look like the following. Notice that the line where you are getting hte error is where it should be attempting to connect to the target server. This is probably where the illegal character is. This should be in your .deploymentOptions file and it would depend on which configuration you had build last.

C:\Program Files\Microsoft SQL Server\90\Tools\Binn\VSShell\Common7\IDE>microsoft.analysisservices.deployment.exe "C:\Data\Projects\SSAS 2005 Samples\Enterprise\bin\Adventure Works DW.asdatabase" /s

Reading input files...
Done
Connecting to the localhost\sql05 server
Database, Adventure Works DW, found on server, localhost\sql05. Applying configuration settings and options...
Analyzing configuration settings...
Done
Analyzing optimization settings...
Done
Analyzing storage information...
Done
Analyzing security information...
Done
Generating processing sequence...
Deploying the 'Adventure Works DW' database to 'localhost\sql05'.
Done

Hope this helps

|||

Thanks for the replies

During install, I am updating the .deploymentOptions file with the ip address and instance where of the Analysis server where the cube is to be deployed. When I replaced the ip address with the system name, it seemed to work fine - looks like it cannot deal with the "." in the ip address - defect?

|||I think it might be. You should log this at http://connect.microsoft.com, it sounds like it might be an issue with the deployment wizard.

Cube Deploying error in SQL2005

Hi All
When I deploy a cube it starts processing then comes up with the error
"connection was either timed out or lost". This also manages to stop the
Analysis Services Service on the Server.
Any ideas?
Thanks
Peterepost in these and you'll probably get a quick responce:
http://groups.google.com/group/micr...ver.olap?lnk=li
[url]http://groups.google.com/group/microsoft.public.sqlserver.datawarehouse?lnk=li[/ur
l]
Byron
P wrote:
> Hi All
> When I deploy a cube it starts processing then comes up with the error
> "connection was either timed out or lost". This also manages to stop the
> Analysis Services Service on the Server.
> Any ideas?
> Thanks
> Pete

Cube Deploy Error

Hello, I'm trying to deploy a cube on Analysis Services and I'm getting the next error:

Errors in the OLAP storage engine: The record was skipped because the attribute key was not found. Attribute: DSAP PRODUCTO of Dimension: DSAP PRODUCTO from Database: SAPIN_BI, Cube: Sapin BI Dllo, Measure Group: DSAP COMBOS, Partition: DSAP COMBOS, Record: 1.

I'm sure the data is consistent and has integrity.... and I verified It ...

Could you please give me a clue ?

What do I have to post or which script do I have to send you ?

Thanks a lot !

jortiz wrote:

Hello, I'm trying to deploy a cube on Analysis Services and I'm getting the next error:

Errors in the OLAP storage engine: The record was skipped because the attribute key was not found. Attribute: DSAP PRODUCTO of Dimension: DSAP PRODUCTO from Database: SAPIN_BI, Cube: Sapin BI Dllo, Measure Group: DSAP COMBOS, Partition: DSAP COMBOS, Record: 1.

I'm sure the data is consistent and has integrity.... and I verified It ...

Could you please give me a clue ?

What do I have to post or which script do I have to send you ?

Thanks a lot !

Hello, Is there any service like a kind of remote desktop via Web, to show you the problem ?

|||

Assuming your cube is built on top of a SQL Server relational database, your best bet might be to use Profiler to capture the SQL queries being generated by SSAS as it processes your cube. Then look at the queries and try to determine what query is returning unexpected data. More than likely the problem lies in the design of the dimension usage within the cube. Perhaps one of the dimensions is related to one of the measure groups based on the wrong attribute or fact table column?

HTH,

Dave Fackler

|||

Dave Fackler wrote:

Assuming your cube is built on top of a SQL Server relational database, your best bet might be to use Profiler to capture the SQL queries being generated by SSAS as it processes your cube. Then look at the queries and try to determine what query is returning unexpected data. More than likely the problem lies in the design of the dimension usage within the cube. Perhaps one of the dimensions is related to one of the measure groups based on the wrong attribute or fact table column?

HTH,

Dave Fackler

Hi Dave, It doesn't matter which dimensions and fact table I use, I get a similar error like this:

Errors in the OLAP storage engine: The attribute key cannot be found: Table: dbo_HSAP_REDENCIONES, Column: NMPRODUCTO_KEY, Value: 1. Errors in the OLAP storage engine: The record was skipped because the attribute key was not found. Attribute: DSAP PRODUCTO of Dimension: DSAP PRODUCTO from Database: SAPIN_BI, Cube: Sapin BI Dllo, Measure Group: HSAP REDENCIONES, Partition: HSAP REDENCIONES, Record: 1. Errors in the OLAP storage engine: The process operation ended because the number of errors encountered during processing reached the defined limit of allowable errors for the operation. Errors in the OLAP storage engine: An error occurred while processing the 'HSAP REDENCIONES' partition of the 'HSAP REDENCIONES' measure group for the 'Sapin BI Dllo' cube from the SAPIN_BI database.

|||

Based on the errror message, it would appear that your fact table has a column named NMPRODUCTO_KEY and a record was read from the fact table that has a value of 1 in that column. In addition, the measure group HSAP REDENCIONES would appear to be related to the DSAP PRODUCTO dimension using the NMPRODUCTO_KEY column to match the DSAP PRODUCTO attribute (which appears to be serving as the key attribute in the dimension). The question is: do any of the members in the DSAP PRODUCTO dimension have a key value of 1 for the DSAP PRODUCTO attribute? What column in the underlying dimension table is the DSAP PRODUCTO attribute based on?

Dave F.

|||

Sorry if I interfere. Have you added a new column to your fact table lately that was not in the processed cube initially?

If you use query binding for the partition(s) this new column will not appear automatically. You will have to add it yourself.

This looks like a problem that I had a few days ago.

Regards

Thomas Ivarsson

|||

Thomas Ivarsson wrote:

Sorry if I interfere. Have you added a new column to your fact table lately that was not in the processed cube initially?

If you use query binding for the partition(s) this new column will not appear automatically. You will have to add it yourself.

This looks like a problem that I had a few days ago.

Regards

Thomas Ivarsson

Thank you so much for your answers !!

|||

What solution did work?

Regards

Thomas Ivarsson