Open in app

Sign In

Write

Sign In

Andrew Lukyanenko
Andrew Lukyanenko

1.7K Followers

Home

About

Published in

Towards Data Science

·Pinned

A long-term Data Science roadmap which WON’T help you become an expert in only several months

Some thoughts on becoming a data scientist. It isn’t easy or fast and requires a lot of efforts, but if you are interested in data science, it is worth it. — From time to time I am asked: how does one become a data scientist? What courses are necessary? How long will it take? How did you become a DS? …

Data Science

7 min read

A long-term Data Science roadmap which WON’T help you become an expert in only several months
A long-term Data Science roadmap which WON’T help you become an expert in only several months
Data Science

7 min read


2 days ago

Paper Review: DreamLLM: Synergistic Multimodal Comprehension and Creation

What do LLMs dream of? — Paper link Project link Code link DreamLLM is a new learning framework designed for Multimodal Large Language Models. It emphasizes the synergy between understanding and generating both text and images. Its two main principles are generative modeling in the raw multimodal space, avoiding the constraints of external feature extractors, and…

Paper Review

5 min read

Paper Review: DreamLLM: Synergistic Multimodal Comprehension and Creation
Paper Review: DreamLLM: Synergistic Multimodal Comprehension and Creation
Paper Review

5 min read


5 days ago

Paper Review: FreeU: Free Lunch in Diffusion U-Net

Free lunch in Generative Networks — Paper link Project link Code link In this paper, the authors explore the potential of diffusion U-Net for improved generation quality. While the U-Net's main structure aids in denoising, its skip connections add high-frequency features, sometimes overshadowing the main backbone's semantics. Based on this understanding, the authors introduce "FreeU", a…

Paper Review

4 min read

Paper Review: FreeU: Free Lunch in Diffusion U-Net
Paper Review: FreeU: Free Lunch in Diffusion U-Net
Paper Review

4 min read


Sep 21

Paper Review: Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers

Marrying LLMs with EA — what could possibly go wrong? — https://arxiv.org/abs/2309.08532 EvoPrompt is a new framework that uses evolutionary algorithms EAs to automate the process of creating prompts for LLMs. Traditional LLMs require manually crafted prompts which can be labor-intensive. By integrating EAs with LLMs, EvoPrompt can generate coherent and readable prompts without needing gradients or parameters. Starting with a…

Paper Review

5 min read

Paper Review: Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt…
Paper Review: Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt…
Paper Review

5 min read


Sep 18

Paper Review: SLiMe: Segment Like Me

One-shot segmentation with the required granularity — Paper link Large vision-language models like Stable Diffusion have made advances in tasks like image editing and 3D shape generation. A new method, SLiMe, has been proposed to use these models for image segmentation with as little as one annotated sample. The process involves extracting attention maps from the SD…

Paper Review

5 min read

Paper Review: SLiMe: Segment Like Me
Paper Review: SLiMe: Segment Like Me
Paper Review

5 min read


Sep 14

Paper Review: TSMixer: An All-MLP Architecture for Time Series Forecasting

MLP — now for time series Paper link Code link Time-series datasets in real-world scenarios often contain multiple variables with intricate patterns. While deep learning models using recurrent or attention mechanisms are commonly used to handle this complexity, recent studies show that basic linear models can sometimes outperform them on…

Paper Review

5 min read

Paper Review: TSMixer: An All-MLP Architecture for Time Series Forecasting
Paper Review: TSMixer: An All-MLP Architecture for Time Series Forecasting
Paper Review

5 min read


Sep 11

Paper Review: Explaining grokking through circuit efficiency

Ungrokking and semi-grokking Paper link The concept of “grokking” refers to a phenomenon in neural networks where a network that initially memorizes the training data but performs poorly on new, unseen data eventually learns to generalize well after further training. The authors propose that this happens because there are two…

Paper Review

5 min read

Paper Review: Explaining grokking through circuit efficiency
Paper Review: Explaining grokking through circuit efficiency
Paper Review

5 min read


Sep 7

Paper Review: Contrastive Feature Masking Open-Vocabulary Vision Transformer

ViT + MAE + Contrastive Learning + PED = SOTA Paper link Contrastive Feature Masking Vision Transformer (CFM-ViT) is a new method for image-text pretraining that enhances open-vocabulary object detection. CFM-ViT integrates the masked autoencoder with contrastive learning, focusing on joint image-text embedding reconstruction instead of typical pixel space, which…

Paper Review

6 min read

Paper Review: Contrastive Feature Masking Open-Vocabulary Vision Transformer
Paper Review: Contrastive Feature Masking Open-Vocabulary Vision Transformer
Paper Review

6 min read


Sep 4

Paper Review: RecMind: Large Language Model Powered Agent For Recommendation

LLMs for recommendations — Paper link Recent advancements have enabled Large Language Models (LLMs) to use external tools and execute multi-step plans, enhancing their performance in various tasks. However, their proficiency in handling personalized queries, such as recommendations, hasn’t been deeply studied. To address this, an LLM-based recommender system named RecMind has been developed. …

Paper Review

5 min read

Paper Review: RecMind: Large Language Model Powered Agent For Recommendation
Paper Review: RecMind: Large Language Model Powered Agent For Recommendation
Paper Review

5 min read


Aug 31

Paper Review: CoTracker: It is Better to Track Together

Gotta Track ’Em All! — Paper link Code link Project link In the paper, a new video motion prediction method called CoTracker is introduced. Traditional methods either estimate motion for all points in a video frame simultaneously using optical flow or track each point’s motion separately throughout the video. …

Paper Review

6 min read

Paper Review: CoTracker: It is Better to Track Together
Paper Review: CoTracker: It is Better to Track Together
Paper Review

6 min read

Andrew Lukyanenko

Andrew Lukyanenko

1.7K Followers

Economist by education. Polyglot as a hobby. DS as a calling. https://andlukyane.com/

Following
  • Aleksandr Lifanov

    Aleksandr Lifanov

  • Martin Heinz

    Martin Heinz

  • Denis Vorotyntsev

    Denis Vorotyntsev

  • Vishnu Subramanian

    Vishnu Subramanian

  • Ivan Panshin

    Ivan Panshin

See all (34)

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech

Teams