Skip to main content

Developer and User Community

Join the discussions about delivering apps and data-driven decisions powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 807 Topics
  • 2,555 Replies
807 Topics
Geir Engdahl
Practitioner
Geir EngdahlChief Technology Officer
posted in Developer and User Community
🚀 Impact 2024: The industrial data and AI conference for and by users | Read More 🚀

Hello Everyone! Exciting news! We're hosting Impact 2024, Cognite’s first User Conference, and we want YOUR use cases to shine. You can read more about Impact 2024 here. Why Share your Use Case?Your stories inspire. Share how your projects have driven real business impact, from boosting revenue to streamlining processes. We also welcome discussions on challenges you've faced and unresolved issues. This can spark meaningful conversations and potential solutions during the event.How to Get Involved:Submit your use case in this thread including it's impact. Based on the submissions, we will organize workshops to explore these use cases further. If your use case is selected, you will receive a free ticket to Impact 2024. We are committed to fostering a collaborative environment while respecting confidentiality and competition concerns, ensuring we all become better together. Mark Your Calendars:Submissions Open: April 25, 2024Submission Deadline: June 30, 2024Winners Announced: August 1, 2

11
M
Committed
1 month ago
S
Active
sridiyerActive
asked in Developer and User Community
Decoder only time series models like TimesFM (google), Lag-Llama, Moirai

I am just playing with the analysis of open industrial data (mostly time series IoT sensor data). It is my understanding that encoders play a role in detecting anomalies in the data. Can decoder only models such as Lag-Llama, TimesFM, Moirai detect anomalies or they can only predict? thank you.

3
Dilini Fernando
Seasoned Practitioner
51 minutes ago
dinesh.makked
Seasoned
dinesh.makkedSeasoned
asked in Developer and User Community
How to use parameterized query in the DB-Extractor?

Hello,I am trying to set up a database extractor for SQL Server database. I would like to pass parameters to the query so that the extraction logic can be controlled via the env file. Here is what I have done.Created an environment variable called “DEPT_ID”, In the YAML file, I am using ${DEPT_ID} to use the value of the env variable.  SELECT *FROM [Employee] WHERE [Dept_id] = ${DEPT_ID} While running the DB-Extractor, I am encountering the following error.KeyError: DEPT_ID I am wondering if the product even supports the use of parameterized queries in the DB-Extractor.Any help will be greatly appreciated.  Thanks,Dinesh

1
I
Seasoned Practitioner
13 hours ago
G
Committed
Gargi BhosaleCommitted
asked in Developer and User Community
how to retrieve metadata key value pairs using python sdk

Hello team, I am bulding an application using the methods in cognite python sdk.I want to create dropdowns for metadata and the values for the same. This similar to the filters on the data explorer screen in the fusion UI:I could not find a direct SDK method to do so.Could you please guide me on how can I achieve that?

7
I
Seasoned Practitioner
14 hours ago
M
Active
Marwen TALEBActive
asked in Developer and User Community
CDC extractors

Hello,  Does CDF provide CDC connectors/extractors for common SQL databases ?  Thanks

1
T
Seasoned Practitioner
19 hours ago
P
Practitioner
Patrick MishimaProduct Specialist
posted in Developer and User Community
Azure with Cognite Data Fusion - Data Integration Part 1

Hello All! As this is my first time writing, I will do a quick introduction. My name is Patrick Mishima, and I am one of the Cognite Product Specialists. My main specialization is data integration and governance. I've worked with data since 2011 with different roles, projects, and job titles all related to data management. I also have experience with various ETL and BI tools, mainly from Microsoft and SAP and a few others.I lead the Product Specialists team, and we'll soon have more articles to share our knowledge and experience with you.Today and in my following articles, I will focus on the different options that Microsoft Azure and Cognite offer on data integration between our platforms and tools. But first, let's talk about a few essential and fundamental points when working with cloud providers. Using a cloud provider, most of the time, we think about saving on infrastructure costs. That is indeed true, but it's not the only truth. When you decide to move to a cloud provider, you

1
R
Seasoned
20 hours ago
H
Active
Henry MartinezActive
published in Developer and User Community
Join me at Impact 2024: Exploring the key to SLB’s success in innovation and collaboration!

Hi Cognite Community! I'm Henry Martinez, Head of Products, Operations data  in SLB.I’m thrilled to announce that I’ll be speaking at Cognite’s Impact user conference, where I’ll be diving deep into how Cognite Hub has played a pivotal role in advancing the SLB and Cognite partnership. We’ve seen firsthand how the Hub has streamlined internal processes, enhanced user onboarding, and boosted product engagement. With nearly 7000 active members, the Hub has become a go-to place for expert advice, industry discussions, and knowledge sharing.Here are some key highlights I’ll cover at Impact:How the Hub’s collaborative environment fosters innovation and strengthens partnerships Ways to make the most of dedicated feature groups for early adopters, gaining access to beta features and expert support Leveraging event calendars, submitting product ideas, and voting on existing ones to actively shape the future of our productWhether you're attending the conference or engaging here in the community

463
STEWART WALLACE
Seasoned Practitioner
1 day ago
S
Committed
sebastianheibo.aksoCommitted
asked in Developer and User Community
Connecting to CDF API in Power BI

I want to visualize some data from the API directly in Power BI. For instance, I want to display data about extraction pipelines https://api-docs.cognite.com/20230101/tag/Extraction-Pipelines/operation/listExtPipes. How can I use the CDF API as a data source in Power BI and input my credentials there in the correct way? Thank you! 

3
Everton Colling
Practitioner
1 day ago
M
Committed
Markus PettersenCommitted
posted in Developer and User Community
CDF API: Shared compute resources across tenants causing problems - dev tenant breaks the prod tenant

Hi there,Before I begin, some terminology to make sure we are on the same page.CDF tenant = CDF project (these have been used interchangeably over time, not sure which is applicable at the moment, I will be referring to it as tenant)CDF cluster = The cloud cluster where the CDF tenants/projects/instances are hostedNow, let’s begin.At Aker BP we have been migrating over to a dedicated CDF cluster on Azure and we have been experiencing some pain points with regards to the compute resources being shared for all tenants on the cluster. Previously our CDF tenants were hosted on GCP on a cluster shared with other companies, this cluster is scaled to handle multiple customers and so the base scaling of the compute resources is much higher than it would be on a dedicated cluster, and as such these problems are less likely to be encountered, not impossible just not as likely. The problem we have seen is that if we from our dev tenant overload the API then the API becomes unavailable for all our

3
Andre Alves
Practitioner
1 day ago
Pablo Palacios
Seasoned
Pablo PalaciosSeasoned
asked in Developer and User Community
Excel Extractor

Hello:I am using DB Extractor  v 3.4.3 to read columns from an Excel file but it gives me the following error: 2024-08-20 18:53:06.550 UTC [ERROR ] QueryExecutor_0 - Unexpected error in query1: Could not read file C:\Cognite\SAT-SX4 - 2023-03-21.xls: required package 'xlsx2csv' not found.Please install using the command `pip install xlsx2csv`.The following is my config file:  databases: - type: spreadsheet name: "DSN_FT" path: "C:\\Cognite\\SAT-SX4 - 2023-03-21.xls" queries: - name: query1 database: "DSN_FT" sheet: "P_VSD" query: #"SELECT STS PreCOM FROM SAT-SX4 - 2023-03-21.xls" "SELECT * FROM P_VSD" destination: type: raw database: FTV table: AE_MOLYNOR primary-key: "{EventID}" What am I doing wrong? Can you help me? 

9
R
Practitioner
1 day ago
A
Committed
Anders NygaardCommitted
asked in Developer and User Community
Javascript SDK: getToken runs only some of the time when using CogniteClient

Across multiple javascript projects, we use the @cognite/sdk. We observe some strange behaviour when it comes to authentication and see the Chrome network panel full of HTTP 401 calls. When debugging the issue, we see that the getToken method supplied to the CogniteClient class only gets called some times. And when it does, the code on our part successfully retrieves a valid token. This leads to some unwanted behaviour and the user sometimes needs to refresh the browser in order to correct the browser state.I suspect the fact that we make a new instance of CogniteClient everytime we use it could be the culprit. I read from the source code baseCogniteClient.ts that the getToken function is not called each time in order to “To prevent calling `getToken` method multiple times in parallel”. Not that I am really able to follow this behaviour over multiple instances of the client.Any pointers as to what might cause this problem?const getToken = async () => {  // this code only hits some t

1
BugGambit
Practitioner
3 days ago
APSHANKAR Sagar
Committed
APSHANKAR SagarCommitted
posted in Developer and User Community
Sequences vs Events vs FDM

Hello,I am trying to understand the difference between Sequences and Events to see what is pertinent for me in a specific use case. For me, both of them allow saving a native CDF object along with a timestamp, enriched with other data. I feel like we can also achieve the same goal by making a data model with timestamps in one column and all the properties we are interested in, in other columns;  though this approach would be harder because it would necessitate using pygen for input output. In my company, we work on Industrial processing lines. At any given moment, a line is operating under a set of conditions, defined by a fixed set of set points, like ‘conveyor speed’ and various temperatures. Let us call the set points a, b, c etc. For set points a, b and c, we have measured values i, j and k.To assess whether the machine is operating normally, we want to compare the aggregated measurements (i-j-k) taken during a period when the set points are a-b-c with a previous instance when the

5
Glen Sykes
Seasoned Practitioner
4 days ago
HanishSharma
Practitioner
HanishSharmaPractitioner
asked in Developer and User Community
Data from Real-time Streaming Protocol (RTSP) into CDF

Hello Cognite experts, I trying to find our some reference material to explore regarding integrating data from RTSP in Cognite. Are there any workflows/POC/documentation/examples available for this data source? 

4
HanishSharma
Practitioner
5 days ago
A
Active
Andreea Elena BalcosActive
asked in Developer and User Community
Hosting pickle file in CDF

Hello,Is it possible to host a pickle file (which contains a ML model) in CDF and use it to make predictions for the available data in the platform?If yes, what are the steps ? I browsed the documentation but I haven’t found anything relevant

1
J
Practitioner
6 days ago
Andre Alves
Practitioner
Andre AlvesPractitioner
posted in Developer and User Community
Predictive Maintenance Model - Real-Time Inference

In some AI demos built on top of Cognite, our approach to real-time inference involves retrieving the latest time series values for the equipment. Since our machine learning models are deployed and running on a cluster outside Cognite, we leverage the SDK to handle real-time inference by retrieving the most recent data as follows:real_time_data_bomb_hfx = cdf_client.time_series.retrieve_latest(id="bomt_hfx_time_series_id")Is anyone working with a different approach to send new data for inference to their machine learning models? I'd be interested in hearing how others are managing this process.We are also exploring more resilient approaches, such as: Streaming Data for Real-Time Inference (Event-Driven Approach): We plan to test Cognite's Kafka extractor as soon as possible to enable more seamless streaming. On-Demand Inference via API: While this approach is synchronous, which has caused challenges for us in the past, we prefer to avoid this method and lean toward more asynchronous

1
Johannes Hovda
Practitioner
6 days ago
Anders Brakestad
Seasoned
Anders BrakestadSeasoned
asked in Developer and User Community
Is it possible to specify whether time series data is aggregated at "start", "midpoint", or "end"?

I am making comparisons between time series data in CDF and PI. The reason is that in our tenants the CDF data is not 100% accurate compared to PI.However, from my testing I think that PI performs its aggregations with the timestamps “centered” at the aggregated time periods, while CDF puts the timestamps at the start of each aggregated period. Is it possible to specify how this is done with the Python API? From my study of the docs it appears not to be the case. The same applies to the PI Web API as well: I cannot specify how the timestamps are placed. The agreement with PI becomes significantly better if I place the CDF timestamps at the center of the aggregated time periods.My current workaround is the following:Fetch RAW data from CDF Shift the timestamps by 0.5x of the granularity Resample to the desired granularity Compute mean Interplate any missing valuesThe issue is that fetching raw data is a lot more time consuming than fetching aggregates. I have been playing with fetching

7
Øystein Aspøy
Committed
7 days ago
A
Committed
Akshay HandeCommitted
asked in Developer and User Community
Parallel task execution not deleting some of the tables from Raw db

Hi,I am running parallel tasks(Cognite functions) in Cognite workflows. One of the task is creating table in Raw db, where as other one is deleting the table. Whatever table is create, its name is passed as input to other function deleting it.First attempt I ran 150 parallel tasks in a 10 workflows(each 15 tasks). One table was not deleted from raw db  In second attempt I ran 200 parallel task in 10 workflows(each 20 tasks). In this case 8 tables were not deleted from rawI was not able to debug why those table not get deleted. As the delete function status was showing ‘Completed’ on Cognite UI.Can you please help why this tables are not getting deleted? If there is a limit of parallel task execution then how to exceed this limit? And how to debug this scenario where there is no function execution failure?Attaching the test workflow for reference. Run workflow-deploy-job.py file to deploy workflow on cognite project. Edit functions.json and workflow-deploy-job.py files for replacing cog

3
A
Committed
8 days ago
Karinnensantos
Seasoned
KarinnensantosSeasoned
asked in Developer and User Community
Downloading Canvas Page

Hey Guys, I would like to know when will be possible download the Canvas Page.

4
Karinnensantos
Seasoned
8 days ago
Anders Brakestad
Seasoned
Anders BrakestadSeasoned
asked in Developer and User Community
Power BI: Use parameter to specify CDF tenant when querying Sequences with Cognite Extractor

Hi guys! We are developing a Power BI dashboard that relies on time series and sequences fetched from CDF using the Cognite Extractor. We have set up a deployment pipeline for our dashboards (Dev, Test, and Prod), where each environment in the PBI pipeline corresponds to data sources in the respective CDF tenant. I.e., our Dev dashboard reads data from our dev tenant in CDF, and so on. We get this to work by configuring a Parameter in Power BI desktop with values that match our CDF tenants.Then we refer to these parameters when we define the data sources. Here is an example of how we use push-down filtering via OData queries from the Advanced Editor in Power Query:Source = Cognite.Contents(cdf_env & "/Timeseries/?$filter=ExternalId eq 'our_special_external_id'", null),The variable “cdf_env” evaluates by default to Dev, and we have configured the deployment pipeline such that this parameter updates automatically when we deploy from Dev to Test, and from Test to Prod. But here is the

2
Anders Brakestad
Seasoned
10 days ago
K
Seasoned
Kristian NymoenSeasoned
posted in Developer and User Community
KPIs on the use and adopion of CDF in the company

Hi all.We’re working on defining KPIs to track our digitalization journey, and think that a KPI on the use and adoption of CDF as opposed to “the old way of doing things” would be useful. I’m posting here in an attempt to hear if the CDF customer community can provide inspiration for how to ensure success and good adoption of CDF among users. Does anyone have thoughts to share on their own metrics for CDF usage?My thoughts so far are tracking the number of unique users logging in to Fusion/Charts, number of API calls against CDF, etc. Although I have not found any direct way as a customer to obtain this information. The Sessions API endpoint could possibly be a place to start?And as a follow-up question; CDF usage in itself is a quite indirect metric on the digital maturity of the business, and on acheived value. My ideal goal would be to find a more direct higher level metric for the entire company, which is not as indirect as user log-ins, and also not as narrow as value obtained for

2
K
Seasoned
11 days ago
A
Active
Ajay GaurActive
asked in Developer and User Community
Can we Keep OPC-UA Real time Data to CDF RAW Tables (Other than meta data)?

Can someone tell me about this. if i Want to keep OPC UA realtime data into cdf RAW using opc ua extractor?

2
Glen Sykes
Seasoned Practitioner
11 days ago
N
Seasoned
Neerajkumar BhatewaraSchlumberger
asked in Developer and User Community
Not able to see the Cognite in Authenticator

Hello I was having the Authenticator setup for logging to zendesk and other cognite sites. But somehow its not there on my mobile now. can you help with re-registering ?my id - nbhatewara@slb.com Neeraj B

1
Dilini Fernando
Seasoned Practitioner
11 days ago
adrianosvieira
Active
adrianosvieiraActive
asked in Developer and User Community
How insert time series dapoint works

I am doing some hands-on exercises, but I am stuck in a point here.The task is to Add some time series data:- Create a time series object for each country asset in CDF called <country>_population and associate it with its corresponding country asset.  Remember to associate the data as well to the data set that you created.   As an example, the time series for Aruba would be called Aruba_population.- Load the data from populations_postprocessed.csv into a pandas dataframe.- Insert the data for each country in this dataframe using client.time_series.data.insert_dataframe.- As a check, retrieve the latest population data for the countries of Latvia, Guatemala, and Benin.- Calculate the total population of the Europe region using the Asset Hierarchy and the time series data.The point I stuck on:=> “Insert the data for each country in this dataframe using client.time_series.data.insert_dataframe”. I am not sure what does this means, although I had done an early exercise …“Insert th

0
adrianosvieira
Active
13 days ago
dalvaniamp
Seasoned
dalvaniampSeasoned
asked in Developer and User Community
Infield offline with Safari

Hello everyone.I was testing the offline mode on Infield and got an odd behavior using an iPad, with Safari: when I get offline, I am not able to select any field to insert values nor click any buttons. It is only possible when I am back online.  Is this how it is supposed to work?I have a video but could not attach here,Thank you in advance.

4
dalvaniamp
Seasoned
14 days ago
Sofie Haug
Practitioner
Sofie HaugCognite Academy Instructor
posted in Developer and User Community
Cognite Data Fusion Bootcamp - New & Improved with CDF Toolkit!

We're excited to announce the first bootcamp following a major update! This version now includes the powerful CDF Toolkit. About the CDF BootcampThe Cognite Data Fusion Bootcamp is an instructor-led, 4-5 days course that guides participants through a hands-on example to develop production-ready solutions with Cognite Data Fusion (CDF). While it is possible to grant access and ingest, transform, and contextualize data manually in CDF through the User Interface, creating a proper CI/CD pipeline that allows the development team to promote the project through different environments (e.g. test & prod) is essential in creating a production-ready solution. With the introduction of the CDF Toolkit, it is now possible to replace different types of CLIs with one command-line tool to configure and administer Cognite Data Fusion (CDF) projects. The Toolkit also includes pre-built templates to help you quickly start your CDF project.The Bootcamp has been developed by CDF and DataOps experts and

1
STEWART WALLACE
Seasoned Practitioner
16 days ago

Badge winners

Show all badges
Terms & ConditionsCookie Settings